Jul 24 15:32:11 devstack cinder-volume[77329]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 15:32:11 devstack cinder-volume[77329]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 15:32:11 devstack cinder-volume[77329]: we strongly recommend against using it for new projects. Jul 24 15:32:11 devstack cinder-volume[77329]: If you are already using Eventlet, we recommend migrating to a different Jul 24 15:32:11 devstack cinder-volume[77329]: framework. For more detail see Jul 24 15:32:11 devstack cinder-volume[77329]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 15:32:11 devstack cinder-volume[77329]: import eventlet # noqa Jul 24 15:32:15 devstack cinder-volume[77329]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:32:15 devstack cinder-volume[77329]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:32:15 devstack cinder-volume[77329]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:32:15 devstack cinder-volume[77329]: INFO dbcounter [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Registered counter for database cinder Jul 24 15:32:16 devstack cinder-volume[77329]: DEBUG oslo_db.sqlalchemy.engines [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:32:16 devstack cinder-volume[77329]: DEBUG dbcounter [-] [77329] Writer thread running {{(pid=77329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:32:16 devstack cinder-volume[77329]: INFO cinder.rpc [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 15:32:16 devstack cinder-volume[77329]: INFO cinder.rpc [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 15:32:16 devstack cinder-volume[77329]: DEBUG oslo_db.sqlalchemy.engines [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:32:16 devstack cinder-volume[77329]: INFO cinder.volume.manager [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Determined volume DB was empty at startup. Jul 24 15:32:16 devstack cinder-volume[77329]: DEBUG cinder.volume.manager [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77329) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 15:32:16 devstack cinder-volume[77329]: INFO cinder.volume.manager [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 24 15:32:16 devstack cinder-volume[77329]: WARNING stevedore.named [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 15:32:16 devstack cinder-volume[77329]: WARNING castellan.key_manager [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:32:16 devstack cinder-volume[77329]: WARNING cinder.keymgr.conf_key_mgr [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:32:16 devstack cinder-volume[77329]: DEBUG cinder.volume.drivers.lvm [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77329) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 24 15:32:16 devstack cinder-volume[77329]: DEBUG oslo_concurrency.processutils [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_concurrency.processutils [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] CMD "cinder-rtstool verify" returned: 0 in 0.404s {{(pid=77329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_db.sqlalchemy.engines [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:32:17 devstack cinder-volume[77329]: INFO cinder.rpc [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 24 15:32:17 devstack cinder-volume[77329]: INFO cinder.rpc [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 24 15:32:17 devstack cinder-volume[77329]: WARNING stevedore.named [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 15:32:17 devstack cinder-volume[77329]: WARNING castellan.key_manager [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:32:17 devstack cinder-volume[77329]: INFO cinder.volume.manager [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_db.sqlalchemy.engines [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:32:17 devstack cinder-volume[77329]: INFO oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Starting 1 workers Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Started child 77549 {{(pid=77329) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Full set of CONF: {{(pid=77329) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] ******************************************************************************** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Configuration options gathered from: {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] ================================================================================ {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] allow_availability_zone_fallback = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] allow_compression_on_image_upload = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] allowed_direct_url_schemes = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] api_rate_limit = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] auth_strategy = keystone {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] az_cache_duration = 3600 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_availability_zone = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77549]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_host = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_stats_polling_interval = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backup_api_class = cinder.backup.api.API {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backup_name_template = backup-%s {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backup_use_same_host = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backup_use_temp_snapshot = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] chap_password = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] chap_username = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_internal_tenant_project_id = bf3eb8b8099b4dcaabf7a3cfe9ba860d {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_internal_tenant_user_id = fc9d988c4028483f8e7ca6a249353ac8 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cloned_volume_same_az = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cluster = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] compression_format = gzip {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] compute_api_class = cinder.compute.nova.API {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] config_dir = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] config_source = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] control_exchange = openstack {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] debug = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] default_availability_zone = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] default_group_type = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] default_volume_type = lvmdriver-1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] disk_geometry = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] driver_client_cert = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] driver_client_cert_key = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] driver_data_namespace = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] driver_ssl_cert_path = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] driver_ssl_cert_verify = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] driver_use_ssl = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] enable_force_upload = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] enable_new_services = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] enable_unsupported_driver = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] enforce_multipath_for_image_xfer = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] filter_function = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_api_insecure = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_api_ssl_compression = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_ca_certificates_file = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_catalog_info = image:glance:publicURL {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_certfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_keyfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_num_retries = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance_request_timeout = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] goodness_function = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] graceful_shutdown_timeout = 5 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] group_api_class = cinder.group.api.API {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] host = devstack {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_compress_on_upload = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_conversion_address_space_limit = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_conversion_cpu_limit = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_conversion_disable = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_upload_use_cinder_backend = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_upload_use_internal_tenant = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_volume_cache_enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_volume_cache_max_count = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] image_volume_cache_max_size_gb = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] init_host_max_objects_retrieval = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] instance_format = [instance: %(uuid)s] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] iscsi_target_flags = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] iscsi_write_cache = on {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] iser_helper = tgtadm {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] iser_ip_address = 192.168.122.31 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] iser_port = 3260 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_color = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_config_append = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_dir = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_file = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_options = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_rotate_interval = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_rotate_interval_type = days {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] log_rotation_type = none {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] max_age = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] max_logfile_count = 30 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] max_logfile_size_mb = 200 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] max_over_subscription_ratio = 20.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] message_reap_interval = 86400 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] message_ttl = 2592000 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] migration_create_volume_timeout_secs = 300 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] monkey_patch = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] monkey_patch_modules = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] my_ip = 192.168.122.31 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] no_snapshot_gb_quota = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] num_iser_scan_tries = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] num_shell_tries = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] num_volume_device_scan_tries = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] nvmeof_conn_info_version = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] nvmet_ns_id = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] nvmet_port_id = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] osapi_max_limit = 1000 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] osapi_volume_ext_list = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] osapi_volume_listen_port = 8776 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] osapi_volume_use_ssl = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] osapi_volume_workers = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] per_volume_size_limit = -1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] periodic_fuzzy_delay = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] periodic_interval = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] public_endpoint = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] publish_errors = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] quota_backup_gigabytes = 1000 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] quota_backups = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77549]: INFO cinder.volume.manager [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] quota_gigabytes = 1000 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] quota_groups = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] quota_snapshots = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] quota_volumes = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] rate_limit_burst = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] rate_limit_except_level = CRITICAL {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] rate_limit_interval = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] reinit_driver_count = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] replication_device = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] report_discard_supported = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] report_interval = 120 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] reservation_clean_interval = 86400 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] reservation_expire = 86400 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] reserved_image_namespaces = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] reserved_percentage = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] rpc_response_timeout = 120 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] run_external_periodic_tasks = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] scst_target_driver = iscsi {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] scst_target_iqn_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_down_time = 720 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] shell_completion = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] snapshot_name_template = snapshot-%s {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] snapshot_same_host = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] split_loggers = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] state_path = /opt/stack/data/cinder {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] storage_availability_zone = nova {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] storage_protocol = iSCSI {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] syslog_log_facility = LOG_USER {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] target_helper = lioadm {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] target_ip_address = 192.168.122.31 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] target_port = 3260 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] target_protocol = iscsi {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] target_secondary_ip_addresses = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] trace_flags = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] transport_url = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] until_refresh = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] use_chap_auth = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] use_default_quota_class = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] use_journal = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] use_json = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] use_multipath_for_image_xfer = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] use_stderr = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] use_syslog = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] verify_glance_signatures = enabled {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_api_class = cinder.volume.api.API {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_backend_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_clear = zero {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_clear_ionice = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_clear_size = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_copy_bps_limit = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_dd_blocksize = 1M {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_name_template = volume-%s {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_service_inithost_offload = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volume_usage_audit_period = month {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] zoning_mode = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_concurrency.disable_process_locking = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.auth_section = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.auth_type = password {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.auth_version = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.cache = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.certfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.include_service_catalog = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.insecure = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.interface = public {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.keyfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_password = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcache_username = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.region_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.service_type = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.backend = dogpile.cache.null {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.backend_argument = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.backend_expiration_time = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.config_prefix = cache.oslo {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.debug_cache_backend = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.enable_retry_client = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.enable_socket_keepalive = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.expiration_time = 600 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.hashclient_retry_attempts = 2 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.memcache_dead_retry = 300 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.memcache_pool_maxsize = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.memcache_sasl_enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.password = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.proxies = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.redis_db = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.redis_server = localhost:6379 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.retry_attempts = 2 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.retry_delay = 0.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.socket_keepalive_count = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.socket_keepalive_idle = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.socket_keepalive_interval = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.socket_timeout = 1.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.tls_allowed_ciphers = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.tls_cafile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.tls_certfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.tls_enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.tls_keyfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cache.username = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] coordination.backend_url = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.asyncio_connection = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.asyncio_slave_connection = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.backend = sqlalchemy {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.connection = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.connection_debug = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.connection_parameters = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.connection_recycle_time = 3600 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.connection_trace = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.db_inc_retry_interval = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.db_max_retries = 20 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.db_max_retry_interval = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.db_retry_interval = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.max_overflow = 50 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.max_pool_size = 5 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.max_retries = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.mysql_wsrep_sync_wait = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.pool_timeout = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.retry_interval = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.slave_connection = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.sqlite_synchronous = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.synchronous_reader = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] database.use_db_reconnect = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.connection_string = messaging:// {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.es_doc_type = notification {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.es_scroll_size = 10000 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.es_scroll_time = 2m {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.filter_error_trace = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.hmac_keys = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.sentinel_service_name = mymaster {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.socket_timeout = 0.1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.trace_requests = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler.trace_sqlalchemy = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler_jaeger.process_tags = {} {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler_jaeger.service_name_prefix = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] profiler_otlp.service_name_prefix = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.enforce_new_defaults = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.policy_default_rule = default {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.policy_file = policy.yaml {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] privsep_osbrick.group = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] privsep_osbrick.helper_command = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] privsep_osbrick.user = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_sys_admin.group = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_sys_admin.helper_command = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] cinder_sys_admin.user = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.auth_section = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.auth_type = password {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.cafile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.certfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.collect_timing = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.insecure = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.keyfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.send_service_user_token = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.split_loggers = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] service_user.timeout = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.auth_section = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.auth_type = password {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.certfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.collect_timing = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.insecure = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.keyfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.region_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.split_loggers = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] glance.timeout = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.backend_availability_zone = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.chap_password = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.chap_username = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.disk_geometry = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.driver_client_cert = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.driver_client_cert_key = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.driver_data_namespace = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.driver_use_ssl = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.extra_capabilities = {} {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.filter_function = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.goodness_function = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.iscsi_target_flags = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.iscsi_write_cache = on {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.iser_helper = tgtadm {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.iser_port = 3260 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.lvm_share_target = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.lvm_type = auto {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.num_shell_tries = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack sudo[77582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.replication_device = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.report_discard_supported = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.reserved_percentage = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack sudo[77582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.target_helper = tgtadm {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.target_port = 3260 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.target_protocol = iscsi {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.trace_flags = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.unique_fqdn_network = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.use_chap_auth = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_backend_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_clear = zero {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_clear_ionice = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_clear_size = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_reports.file_event_handler = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_reports.log_dir = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.backend_host = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.chap_password = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.chap_username = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.disk_geometry = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.driver_client_cert = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.extra_capabilities = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.filter_function = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.goodness_function = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.iser_helper = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.iser_ip_address = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.iser_port = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.lvm_share_target = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.lvm_type = auto {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.num_shell_tries = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.replication_device = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.report_discard_supported = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.reserved_percentage = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.scst_target_driver = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.storage_protocol = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.target_helper = lioadm {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.target_ip_address = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.target_port = 3260 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.trace_flags = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.use_chap_auth = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_clear = zero {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_clear_size = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] lvmdriver-1.volumes_dir = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.ssl = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_notifications.driver = [] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_notifications.retry = -1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] key_manager.fixed_key = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.barbican_api_version = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.barbican_endpoint = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.barbican_endpoint_type = public {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.barbican_region_name = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.cafile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.certfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.collect_timing = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.insecure = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.keyfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.number_of_retries = 60 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.retry_delay = 1 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.send_service_user_token = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.split_loggers = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.timeout = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.verify_ssl = True {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican.verify_ssl_path = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.auth_section = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.auth_type = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.cafile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.certfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.collect_timing = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.insecure = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.keyfile = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.split_loggers = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] barbican_service_user.timeout = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.approle_role_id = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.approle_secret_id = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.auth_method = approle {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.auth_path = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.kv_mountpoint = secret {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.kv_path = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.kv_version = 2 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.namespace = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.root_token_id = **** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.ssl_ca_crt_file = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.timeout = 60.0 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.token_file = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.token_role = None {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.use_ssl = False {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:32:17 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] ******************************************************************************** {{(pid=77329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 15:32:17 devstack sudo[77582]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:17 devstack sudo[77668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:17 devstack sudo[77668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:17 devstack sudo[77668]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:32:17 devstack cinder-volume[77549]: INFO cinder.brick.local_dev.lvm [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:17 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:17 devstack sudo[77758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:32:17 devstack sudo[77758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:18 devstack sudo[77758]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:18 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:18 devstack cinder-volume[77549]: DEBUG cinder.brick.local_dev.lvm [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77549) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 24 15:32:18 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:18 devstack sudo[77846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:18 devstack sudo[77846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:18 devstack sudo[77846]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:18 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.552s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:18 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:18 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:18 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:18 devstack sudo[78075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:18 devstack sudo[78075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:19 devstack sudo[78075]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:19 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:19 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:19 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:19 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:19 devstack sudo[78081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 24 15:32:19 devstack sudo[78081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:19 devstack sudo[78081]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:19 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.353s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:19 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:19 devstack sudo[78164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:32:19 devstack sudo[78164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:19 devstack sudo[78164]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:19 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:19 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:19 devstack sudo[78167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:32:19 devstack sudo[78167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:20 devstack sudo[78167]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:20 devstack sudo[78240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:32:20 devstack sudo[78240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:20 devstack sudo[78240]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:20 devstack sudo[78259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:20 devstack sudo[78259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:20 devstack sudo[78259]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:20 devstack sudo[78263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:20 devstack sudo[78263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:20 devstack sudo[78263]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:20 devstack cinder-volume[77549]: INFO cinder.volume.drivers.lvm [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:20 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:20 devstack sudo[78267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:20 devstack sudo[78267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:21 devstack sudo[78267]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:21 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:21 devstack cinder-volume[77549]: DEBUG cinder.volume.drivers.lvm [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Updating volume stats {{(pid=77549) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:32:21 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:21 devstack sudo[78276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:32:21 devstack sudo[78276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:21 devstack sudo[78276]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:21 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:21 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:21 devstack sudo[78279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:32:21 devstack sudo[78279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:21 devstack sudo[78279]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:21 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:21 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:21 devstack sudo[78283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:21 devstack sudo[78283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:22 devstack sudo[78283]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:22 devstack sudo[78287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:32:22 devstack sudo[78287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:22 devstack sudo[78287]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:22 devstack cinder-volume[77549]: INFO cinder.volume.driver [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG cinder.volume.driver [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77549) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG oslo_db.sqlalchemy.engines [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77549) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG dbcounter [-] [77549] Writer thread running {{(pid=77549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG cinder.db.api [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Building query based on filter {{(pid=77549) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG cinder.image.image_utils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77549) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 15:32:22 devstack cinder-volume[77549]: INFO cinder.keymgr.migration [None req-f5694d65-c7ae-4fa7-8c71-41a373d2a410 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG cinder.volume.drivers.lvm [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Updating volume stats {{(pid=77549) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:22 devstack sudo[78291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:32:22 devstack sudo[78291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:22 devstack sudo[78291]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:22 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:22 devstack sudo[78294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:32:22 devstack sudo[78294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:23 devstack sudo[78294]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:23 devstack sudo[78299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:23 devstack sudo[78299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:23 devstack sudo[78299]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:23 devstack sudo[78302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:32:23 devstack sudo[78302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:23 devstack sudo[78302]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG cinder.manager [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Notifying Schedulers of capabilities ... {{(pid=77549) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:32:23 devstack cinder-volume[77549]: INFO cinder.volume.manager [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Driver initialization completed successfully. Jul 24 15:32:23 devstack cinder-volume[77549]: INFO cinder.manager [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Initiating service 2 cleanup Jul 24 15:32:23 devstack cinder-volume[77549]: INFO cinder.manager [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Service 2 cleanup completed. Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG cinder.service [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Creating RPC server for service cinder-volume {{(pid=77549) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG cinder.service [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77549) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 15:32:23 devstack cinder-volume[77549]: INFO cinder.volume.manager [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG cinder.volume.drivers.lvm [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Updating volume stats {{(pid=77549) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:32:23 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:23 devstack sudo[78306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:32:23 devstack sudo[78306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:24 devstack sudo[78306]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:24 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:24 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:24 devstack sudo[78309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:32:24 devstack sudo[78309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:24 devstack sudo[78309]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:24 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:24 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:24 devstack sudo[78315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:32:24 devstack sudo[78315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:24 devstack sudo[78315]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:24 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:24 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:32:24 devstack sudo[78320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:32:24 devstack sudo[78320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:32:24 devstack sudo[78320]: pam_unix(sudo:session): session closed for user root Jul 24 15:32:24 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:32:24 devstack cinder-volume[77549]: INFO cinder.volume.manager [None req-a81e77e4-74fb-4c7b-98b0-f26721f29b08 None None] Driver post RPC initialization completed successfully. Jul 24 15:32:27 devstack cinder-volume[77329]: DEBUG dbcounter [-] [77329] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:32:34 devstack cinder-volume[77549]: DEBUG dbcounter [-] [77549] Writing DB stats cinder:SELECT=3 {{(pid=77549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:32:34 devstack cinder-volume[77549]: DEBUG dbcounter [-] [77549] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:32:44 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager._thread_info {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:32:44 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread count: 6 {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:32:44 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread info: [<_MainThread(MainThread, started 130119932358784)>, , , , , ] {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:33:44 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:33:44 devstack cinder-volume[77549]: DEBUG cinder.volume.drivers.lvm [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Updating volume stats {{(pid=77549) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:33:44 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:33:44 devstack sudo[80976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:33:44 devstack sudo[80976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:33:45 devstack sudo[80976]: pam_unix(sudo:session): session closed for user root Jul 24 15:33:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:33:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:33:45 devstack sudo[80981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:33:45 devstack sudo[80981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:33:45 devstack sudo[80981]: pam_unix(sudo:session): session closed for user root Jul 24 15:33:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:33:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:33:45 devstack sudo[80984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:33:45 devstack sudo[80984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:33:45 devstack sudo[80984]: pam_unix(sudo:session): session closed for user root Jul 24 15:33:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:33:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:33:45 devstack sudo[80987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:33:45 devstack sudo[80987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:33:46 devstack sudo[80987]: pam_unix(sudo:session): session closed for user root Jul 24 15:33:46 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:33:46 devstack cinder-volume[77549]: DEBUG cinder.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Notifying Schedulers of capabilities ... {{(pid=77549) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:33:46 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager._thread_info {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:33:46 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread count: 6 {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:33:46 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread info: [<_MainThread(MainThread, started 130119932358784)>, , , , , ] {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:34:34 devstack cinder-volume[77549]: DEBUG dbcounter [-] [77549] Writing DB stats cinder:SELECT=1 {{(pid=77549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:34:34 devstack cinder-volume[77549]: DEBUG dbcounter [-] [77549] Writing DB stats cinder:UPDATE=1 {{(pid=77549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:34:44 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:34:44 devstack cinder-volume[77549]: DEBUG cinder.volume.drivers.lvm [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Updating volume stats {{(pid=77549) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:34:44 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:34:44 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:34:44 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:34:45 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:34:45 devstack sudo[83975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:34:45 devstack sudo[83975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:34:45 devstack sudo[83975]: pam_unix(sudo:session): session closed for user root Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:34:45 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:34:45 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:34:45 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:34:45 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:34:45 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:34:45 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG cinder.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Notifying Schedulers of capabilities ... {{(pid=77549) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager._thread_info {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread count: 6 {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:34:45 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread info: [<_MainThread(MainThread, started 130119932358784)>, , , , , ] {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:35:44 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:35:44 devstack cinder-volume[77549]: DEBUG cinder.volume.drivers.lvm [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Updating volume stats {{(pid=77549) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:35:44 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:35:44 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:35:44 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:35:45 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:35:45 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:35:45 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:35:45 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:35:45 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:35:45 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:35:45 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:35:45 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:35:45 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:35:45 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG cinder.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Notifying Schedulers of capabilities ... {{(pid=77549) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager._thread_info {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread count: 6 {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:35:45 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread info: [<_MainThread(MainThread, started 130119932358784)>, , , , , ] {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:36:34 devstack cinder-volume[77549]: DEBUG dbcounter [-] [77549] Writing DB stats cinder:SELECT=1 {{(pid=77549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:36:34 devstack cinder-volume[77549]: DEBUG dbcounter [-] [77549] Writing DB stats cinder:UPDATE=1 {{(pid=77549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:36:44 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:36:44 devstack cinder-volume[77549]: DEBUG cinder.volume.drivers.lvm [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Updating volume stats {{(pid=77549) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:36:44 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:44 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:36:44 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:45 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:45 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:45 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:45 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:45 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:45 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:45 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:45 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:45 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:45 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG oslo_concurrency.processutils [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG cinder.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Notifying Schedulers of capabilities ... {{(pid=77549) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG oslo_service.periodic_task [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] Running periodic task VolumeManager._thread_info {{(pid=77549) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread count: 6 {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:36:45 devstack cinder-volume[77549]: DEBUG cinder.volume.manager [None req-1d199221-3cfb-44d9-8e60-e8c0b1cd504a None None] thread info: [<_MainThread(MainThread, started 130119932358784)>, , , , , ] {{(pid=77549) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:36:54 devstack cinder-volume[77329]: INFO oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Caught SIGTERM, stopping children Jul 24 15:36:54 devstack cinder-volume[77329]: DEBUG oslo_concurrency.lockutils [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Acquiring lock "singleton_lock" {{(pid=77329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:36:54 devstack cinder-volume[77329]: DEBUG oslo_concurrency.lockutils [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Acquired lock "singleton_lock" {{(pid=77329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:36:54 devstack cinder-volume[77329]: DEBUG oslo_concurrency.lockutils [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Releasing lock "singleton_lock" {{(pid=77329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:36:54 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Stop services. {{(pid=77329) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 24 15:36:54 devstack cinder-volume[77329]: DEBUG oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Killing children. {{(pid=77329) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 24 15:36:54 devstack cinder-volume[77329]: INFO oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Waiting on 1 children to exit Jul 24 15:36:58 devstack cinder-volume[77549]: DEBUG oslo_concurrency.lockutils [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Acquiring lock "singleton_lock" {{(pid=77549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:36:58 devstack cinder-volume[77549]: DEBUG oslo_concurrency.lockutils [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Acquired lock "singleton_lock" {{(pid=77549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:36:58 devstack cinder-volume[77549]: DEBUG oslo_concurrency.lockutils [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Releasing lock "singleton_lock" {{(pid=77549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:36:58 devstack cinder-volume[77549]: WARNING amqp [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 15:36:58 devstack cinder-volume[77549]: WARNING amqp [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 15:36:58 devstack cinder-volume[77329]: INFO oslo_service.backend._eventlet.service [None req-a3b65504-ab58-46cc-bfc8-2ff1d05c5388 None None] Child 77549 exited with status 0 Jul 24 15:36:59 devstack cinder-volume[87591]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 15:36:59 devstack cinder-volume[87591]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 15:36:59 devstack cinder-volume[87591]: we strongly recommend against using it for new projects. Jul 24 15:36:59 devstack cinder-volume[87591]: If you are already using Eventlet, we recommend migrating to a different Jul 24 15:36:59 devstack cinder-volume[87591]: framework. For more detail see Jul 24 15:36:59 devstack cinder-volume[87591]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 15:36:59 devstack cinder-volume[87591]: import eventlet # noqa Jul 24 15:37:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:37:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:37:01 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:37:02 devstack cinder-volume[87591]: INFO dbcounter [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Registered counter for database cinder Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_db.sqlalchemy.engines [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG dbcounter [-] [87591] Writer thread running {{(pid=87591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:37:02 devstack cinder-volume[87591]: INFO cinder.rpc [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 15:37:02 devstack cinder-volume[87591]: INFO cinder.rpc [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_db.sqlalchemy.engines [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:37:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Determined volume DB was empty at startup. Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG cinder.volume.manager [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87591) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 15:37:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 24 15:37:02 devstack cinder-volume[87591]: WARNING stevedore.named [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 15:37:02 devstack cinder-volume[87591]: WARNING castellan.key_manager [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:37:02 devstack cinder-volume[87591]: WARNING cinder.keymgr.conf_key_mgr [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:37:02 devstack cinder-volume[87591]: INFO cinder.volume.manager [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_db.sqlalchemy.engines [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:37:02 devstack cinder-volume[87591]: INFO oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Starting 1 workers Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Started child 87812 {{(pid=87591) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Full set of CONF: {{(pid=87591) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] ******************************************************************************** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Configuration options gathered from: {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] ================================================================================ {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 15:37:02 devstack cinder-volume[87812]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] allow_availability_zone_fallback = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] allow_compression_on_image_upload = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] allowed_direct_url_schemes = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] api_rate_limit = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] auth_strategy = keystone {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_availability_zone = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_host = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_stats_polling_interval = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backup_api_class = cinder.backup.api.API {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backup_name_template = backup-%s {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backup_use_same_host = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backup_use_temp_snapshot = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] chap_password = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] chap_username = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_internal_tenant_project_id = bf3eb8b8099b4dcaabf7a3cfe9ba860d {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_internal_tenant_user_id = fc9d988c4028483f8e7ca6a249353ac8 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cluster = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] compression_format = gzip {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] compute_api_class = cinder.compute.nova.API {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] config_dir = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] config_source = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] control_exchange = openstack {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] debug = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] default_availability_zone = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] default_group_type = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] default_volume_type = QuobyteHD {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] disk_geometry = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] driver_client_cert = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] driver_client_cert_key = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] driver_data_namespace = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] driver_ssl_cert_path = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] driver_ssl_cert_verify = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:02 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] driver_use_ssl = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] enable_new_services = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] enable_unsupported_driver = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] enabled_backends = ['QuobyteHD'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] enforce_multipath_for_image_xfer = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] filter_function = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_api_insecure = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_api_ssl_compression = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_ca_certificates_file = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_catalog_info = image:glance:publicURL {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_certfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_keyfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_num_retries = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87812]: INFO cinder.volume.manager [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Starting volume driver QuobyteDriver (1.2) Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.remotefs [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87812) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance_request_timeout = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] goodness_function = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] graceful_shutdown_timeout = 5 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] group_api_class = cinder.group.api.API {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] host = devstack {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_compress_on_upload = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_conversion_address_space_limit = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_conversion_cpu_limit = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_conversion_disable = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_upload_use_cinder_backend = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_upload_use_internal_tenant = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_volume_cache_enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_volume_cache_max_count = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] image_volume_cache_max_size_gb = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] init_host_max_objects_retrieval = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] instance_format = [instance: %(uuid)s] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] iscsi_target_flags = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] iscsi_write_cache = on {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] iser_helper = tgtadm {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] iser_ip_address = 192.168.122.31 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] iser_port = 3260 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_color = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_config_append = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_dir = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_file = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_options = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_rotate_interval = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_rotate_interval_type = days {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] log_rotation_type = none {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] max_age = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] max_logfile_count = 30 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] max_logfile_size_mb = 200 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] max_over_subscription_ratio = 20.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] message_reap_interval = 86400 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] message_ttl = 2592000 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] migration_create_volume_timeout_secs = 300 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] monkey_patch = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] monkey_patch_modules = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] my_ip = 192.168.122.31 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] no_snapshot_gb_quota = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] num_iser_scan_tries = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] num_shell_tries = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] num_volume_device_scan_tries = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] nvmeof_conn_info_version = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] nvmet_ns_id = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] nvmet_port_id = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] osapi_max_limit = 1000 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87812) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 24 15:37:03 devstack cinder-volume[87812]: WARNING cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 24 15:37:03 devstack cinder-volume[87812]: WARNING cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] osapi_volume_ext_list = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] osapi_volume_listen = 0.0.0.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Running cmd (subprocess): mount.quobyte {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] osapi_volume_listen_port = 8776 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] osapi_volume_use_ssl = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] osapi_volume_workers = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] per_volume_size_limit = -1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] periodic_fuzzy_delay = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] periodic_interval = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] project_id_regex = [0-9a-f\-]+ {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] public_endpoint = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] publish_errors = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] quota_backup_gigabytes = 1000 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] quota_backups = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] quota_gigabytes = 1000 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] quota_groups = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] quota_snapshots = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] quota_volumes = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] rate_limit_burst = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] rate_limit_except_level = CRITICAL {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] rate_limit_interval = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] reinit_driver_count = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] replication_device = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] report_discard_supported = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] report_interval = 120 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] reservation_clean_interval = 86400 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] reservation_expire = 86400 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] reserved_image_namespaces = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] reserved_percentage = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] rpc_response_timeout = 120 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] run_external_periodic_tasks = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] scst_target_driver = iscsi {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] scst_target_iqn_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_down_time = 720 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] shell_completion = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] snapshot_name_template = snapshot-%s {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] split_loggers = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] state_path = /opt/stack/data/cinder {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] storage_availability_zone = nova {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] storage_protocol = iSCSI {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] syslog_log_facility = LOG_USER {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] target_helper = lioadm {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] target_ip_address = 192.168.122.31 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] target_port = 3260 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] target_protocol = iscsi {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] target_secondary_ip_addresses = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] trace_flags = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] transfer_api_class = cinder.transfer.api.API {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] transport_url = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] until_refresh = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] use_chap_auth = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] use_default_quota_class = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] use_journal = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] use_json = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] use_multipath_for_image_xfer = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] use_stderr = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] use_syslog = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] verify_glance_signatures = enabled {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_api_class = cinder.volume.api.API {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_backend_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_clear = zero {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_clear_ionice = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_clear_size = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_copy_bps_limit = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_dd_blocksize = 1M {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_name_template = volume-%s {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_service_inithost_offload = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volume_usage_audit_period = month {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] zoning_mode = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_concurrency.disable_process_locking = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.auth_section = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.auth_type = password {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.auth_version = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.cache = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.certfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.include_service_catalog = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.insecure = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.interface = public {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.keyfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_password = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcache_username = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.region_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.service_type = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.backend = dogpile.cache.null {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.backend_argument = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.backend_expiration_time = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.config_prefix = cache.oslo {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.debug_cache_backend = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.enable_retry_client = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.enable_socket_keepalive = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.expiration_time = 600 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.hashclient_retry_attempts = 2 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.memcache_dead_retry = 300 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.memcache_pool_maxsize = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.memcache_sasl_enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.password = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.proxies = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.redis_db = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.redis_server = localhost:6379 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.retry_attempts = 2 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.retry_delay = 0.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.socket_keepalive_count = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.socket_keepalive_idle = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.socket_keepalive_interval = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.socket_timeout = 1.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.tls_allowed_ciphers = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.tls_cafile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.tls_certfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.tls_enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.tls_keyfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cache.username = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] coordination.backend_url = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.asyncio_connection = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.asyncio_slave_connection = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.backend = sqlalchemy {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.connection = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.connection_debug = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.connection_parameters = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.connection_recycle_time = 3600 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.connection_trace = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.db_inc_retry_interval = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.db_max_retries = 20 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.db_max_retry_interval = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.db_retry_interval = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.max_overflow = 50 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.max_pool_size = 5 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.max_retries = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.mysql_wsrep_sync_wait = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.pool_timeout = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.retry_interval = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.slave_connection = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.sqlite_synchronous = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.synchronous_reader = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] database.use_db_reconnect = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.connection_string = messaging:// {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.es_doc_type = notification {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.es_scroll_size = 10000 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.es_scroll_time = 2m {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.filter_error_trace = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.hmac_keys = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.sentinel_service_name = mymaster {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.socket_timeout = 0.1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.trace_requests = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler.trace_sqlalchemy = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler_jaeger.process_tags = {} {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler_jaeger.service_name_prefix = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] profiler_otlp.service_name_prefix = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.enforce_new_defaults = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.policy_default_rule = default {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.policy_file = policy.yaml {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_policy.remote_timeout = 60.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] privsep_osbrick.group = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] privsep_osbrick.helper_command = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] privsep_osbrick.user = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_sys_admin.group = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_sys_admin.helper_command = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] cinder_sys_admin.user = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.auth_section = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.auth_type = password {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.cafile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.certfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.collect_timing = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.insecure = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.keyfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.send_service_user_token = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.split_loggers = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] service_user.timeout = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.auth_section = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.auth_type = password {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.certfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.collect_timing = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.insecure = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.keyfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.region_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.split_loggers = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] glance.timeout = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.backend_availability_zone = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.chap_password = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.chap_username = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.disk_geometry = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.driver_client_cert = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.driver_client_cert_key = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.driver_data_namespace = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.driver_use_ssl = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.extra_capabilities = {} {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.filter_function = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.goodness_function = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.iscsi_target_flags = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.iscsi_write_cache = on {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.iser_helper = tgtadm {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.iser_port = 3260 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_host = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_login = admin {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_mount_options = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_password = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_private_key = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_share_path = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_ssh_port = 22 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.num_shell_tries = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] CMD "mount.quobyte" returned: 1 in 0.108s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.quobyte_volume_url = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.replication_device = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.report_discard_supported = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.reserved_percentage = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=87812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87812]: INFO cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 ... Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.target_helper = tgtadm {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f -c /etc/quobyte/client-cinder.cfg {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.target_port = 3260 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.target_protocol = iscsi {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.trace_flags = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.unique_fqdn_network = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.use_chap_auth = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volume_backend_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volume_clear = zero {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volume_clear_ionice = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volume_clear_size = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_reports.file_event_handler = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_reports.log_dir = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.backend_availability_zone = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.backend_host = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.chap_password = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f -c /etc/quobyte/client-cinder.cfg Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.chap_username = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.chiscsi_conf = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.disk_geometry = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.driver_client_cert = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.driver_data_namespace = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.driver_use_ssl = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.extra_capabilities = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.filter_function = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.goodness_function = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.iscsi_target_flags = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.iscsi_write_cache = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.iser_helper = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.iser_ip_address = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.iser_port = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.iser_target_prefix = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_host = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_login = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_mount_options = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_password = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_private_key = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_share_path = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_ssh_port = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.num_shell_tries = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nvmet_ns_id = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.nvmet_port_id = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.replication_device = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.report_discard_supported = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.reserved_percentage = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.scst_target_driver = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.storage_protocol = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.target_helper = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.target_ip_address = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.target_port = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.target_prefix = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.target_protocol = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.trace_flags = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.unique_fqdn_network = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.use_chap_auth = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volume_clear = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volume_clear_ionice = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volume_clear_size = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] QuobyteHD.volumes_dir = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.ssl = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.ssl_version = {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_notifications.driver = [] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_notifications.retry = -1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] key_manager.fixed_key = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.barbican_api_version = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.barbican_endpoint = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.barbican_endpoint_type = public {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.barbican_region_name = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.cafile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.certfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.collect_timing = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.insecure = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.keyfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.number_of_retries = 60 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.retry_delay = 1 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.send_service_user_token = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.split_loggers = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.timeout = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.verify_ssl = True {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican.verify_ssl_path = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.auth_section = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.auth_type = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.cafile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.certfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.collect_timing = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.insecure = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.keyfile = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.split_loggers = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] barbican_service_user.timeout = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.approle_role_id = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.approle_secret_id = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.auth_method = approle {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.auth_path = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.kv_mountpoint = secret {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.kv_path = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.kv_version = 2 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.namespace = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.root_token_id = **** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.ssl_ca_crt_file = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.timeout = 60.0 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.token_file = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.token_role = None {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.use_ssl = False {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:03 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] ******************************************************************************** {{(pid=87591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 15:37:03 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.409s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:03 devstack cinder-volume[87812]: INFO cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 succeeded Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=87812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.418s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:03 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:37:03 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:37:03 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.251s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:03 devstack cinder-volume[87812]: INFO cinder.volume.driver [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.volume.driver [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87812) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_db.sqlalchemy.engines [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG dbcounter [-] [87812] Writer thread running {{(pid=87812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.db.api [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Building query based on filter {{(pid=87812) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.image.image_utils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87812) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 15:37:03 devstack cinder-volume[87812]: INFO cinder.keymgr.migration [None req-32b6911a-02d0-40f8-a0fa-3964e139ed74 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=87812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=87812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:37:03 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:04 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:37:04 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:37:04 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.258s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG cinder.manager [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Notifying Schedulers of capabilities ... {{(pid=87812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:37:04 devstack cinder-volume[87812]: INFO cinder.volume.manager [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Driver initialization completed successfully. Jul 24 15:37:04 devstack cinder-volume[87812]: INFO cinder.manager [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Initiating service 3 cleanup Jul 24 15:37:04 devstack cinder-volume[87812]: INFO cinder.manager [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Service 3 cleanup completed. Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG cinder.service [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Creating RPC server for service cinder-volume {{(pid=87812) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG cinder.service [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87812) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 15:37:04 devstack cinder-volume[87812]: INFO cinder.volume.manager [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=87812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=87812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:04 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:37:04 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:37:04 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Jul 24 15:37:04 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.262s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:04 devstack cinder-volume[87812]: INFO cinder.volume.manager [None req-ee4b578a-d016-47f4-996b-10b82278df31 None None] Driver post RPC initialization completed successfully. Jul 24 15:37:08 devstack cinder-volume[87591]: INFO oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Caught SIGTERM, stopping children Jul 24 15:37:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Acquiring lock "singleton_lock" {{(pid=87591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:37:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Acquired lock "singleton_lock" {{(pid=87591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:37:08 devstack cinder-volume[87591]: DEBUG oslo_concurrency.lockutils [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Releasing lock "singleton_lock" {{(pid=87591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:37:08 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Stop services. {{(pid=87591) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 24 15:37:08 devstack cinder-volume[87591]: DEBUG oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Killing children. {{(pid=87591) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 24 15:37:08 devstack cinder-volume[87591]: INFO oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Waiting on 1 children to exit Jul 24 15:37:08 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Acquiring lock "singleton_lock" {{(pid=87812) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:37:08 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Acquired lock "singleton_lock" {{(pid=87812) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:37:08 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Releasing lock "singleton_lock" {{(pid=87812) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:37:08 devstack cinder-volume[87812]: WARNING amqp [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 15:37:08 devstack cinder-volume[87812]: WARNING amqp [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 15:37:08 devstack cinder-volume[87591]: INFO oslo_service.backend._eventlet.service [None req-8ba171d0-0859-4db9-a99b-73448069000f None None] Child 87812 exited with status 0 Jul 24 15:37:09 devstack cinder-volume[88169]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 15:37:09 devstack cinder-volume[88169]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 15:37:09 devstack cinder-volume[88169]: we strongly recommend against using it for new projects. Jul 24 15:37:09 devstack cinder-volume[88169]: If you are already using Eventlet, we recommend migrating to a different Jul 24 15:37:09 devstack cinder-volume[88169]: framework. For more detail see Jul 24 15:37:09 devstack cinder-volume[88169]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 15:37:09 devstack cinder-volume[88169]: import eventlet # noqa Jul 24 15:37:11 devstack cinder-volume[88169]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:37:11 devstack cinder-volume[88169]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:37:11 devstack cinder-volume[88169]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88169) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:37:11 devstack cinder-volume[88169]: INFO dbcounter [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Registered counter for database cinder Jul 24 15:37:11 devstack cinder-volume[88169]: DEBUG oslo_db.sqlalchemy.engines [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG dbcounter [-] [88169] Writer thread running {{(pid=88169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:37:12 devstack cinder-volume[88169]: INFO cinder.rpc [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 15:37:12 devstack cinder-volume[88169]: INFO cinder.rpc [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_db.sqlalchemy.engines [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:37:12 devstack cinder-volume[88169]: INFO cinder.volume.manager [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Determined volume DB was empty at startup. Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG cinder.volume.manager [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88169) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 15:37:12 devstack cinder-volume[88169]: WARNING stevedore.named [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 15:37:12 devstack cinder-volume[88169]: WARNING castellan.key_manager [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:37:12 devstack cinder-volume[88169]: WARNING cinder.keymgr.conf_key_mgr [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:37:12 devstack cinder-volume[88169]: INFO cinder.volume.manager [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_db.sqlalchemy.engines [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:37:12 devstack cinder-volume[88169]: INFO oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Starting 1 workers Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Started child 88251 {{(pid=88169) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Full set of CONF: {{(pid=88169) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] ******************************************************************************** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] Configuration options gathered from: {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] ================================================================================ {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] allow_availability_zone_fallback = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] allow_compression_on_image_upload = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] allowed_direct_url_schemes = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] api_rate_limit = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] auth_strategy = keystone {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_availability_zone = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_host = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88251]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_stats_polling_interval = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backup_api_class = cinder.backup.api.API {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backup_name_template = backup-%s {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backup_use_same_host = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backup_use_temp_snapshot = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] chap_password = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] chap_username = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_internal_tenant_project_id = bf3eb8b8099b4dcaabf7a3cfe9ba860d {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_internal_tenant_user_id = fc9d988c4028483f8e7ca6a249353ac8 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cluster = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] compression_format = gzip {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] compute_api_class = cinder.compute.nova.API {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] config_dir = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] config_source = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] control_exchange = openstack {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] debug = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] default_availability_zone = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] default_group_type = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] default_volume_type = QuobyteHD {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] disk_geometry = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] driver_client_cert = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] driver_client_cert_key = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] driver_data_namespace = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] driver_ssl_cert_path = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] driver_ssl_cert_verify = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] driver_use_ssl = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] enable_new_services = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] enable_unsupported_driver = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] enabled_backends = ['QuobyteHD'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] enforce_multipath_for_image_xfer = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] filter_function = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_api_insecure = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_api_ssl_compression = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_ca_certificates_file = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_catalog_info = image:glance:publicURL {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_certfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_keyfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_num_retries = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance_request_timeout = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] goodness_function = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] graceful_shutdown_timeout = 5 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] group_api_class = cinder.group.api.API {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] host = devstack {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_compress_on_upload = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_conversion_address_space_limit = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_conversion_cpu_limit = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_conversion_disable = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_upload_use_cinder_backend = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_upload_use_internal_tenant = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_volume_cache_enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_volume_cache_max_count = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] image_volume_cache_max_size_gb = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] init_host_max_objects_retrieval = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] instance_format = [instance: %(uuid)s] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] iscsi_target_flags = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] iscsi_write_cache = on {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] iser_helper = tgtadm {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] iser_ip_address = 192.168.122.31 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] iser_port = 3260 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_color = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_config_append = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_dir = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_file = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_options = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_rotate_interval = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_rotate_interval_type = days {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] log_rotation_type = none {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] max_age = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] max_logfile_count = 30 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] max_logfile_size_mb = 200 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] max_over_subscription_ratio = 20.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] message_reap_interval = 86400 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] message_ttl = 2592000 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] migration_create_volume_timeout_secs = 300 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] monkey_patch = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] monkey_patch_modules = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] my_ip = 192.168.122.31 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] no_snapshot_gb_quota = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] num_iser_scan_tries = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] num_shell_tries = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] num_volume_device_scan_tries = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] nvmeof_conn_info_version = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] nvmet_ns_id = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] nvmet_port_id = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] osapi_max_limit = 1000 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] osapi_volume_ext_list = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] osapi_volume_listen_port = 8776 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] osapi_volume_use_ssl = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] osapi_volume_workers = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] per_volume_size_limit = -1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] periodic_fuzzy_delay = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] periodic_interval = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] public_endpoint = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] publish_errors = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] quota_backup_gigabytes = 1000 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] quota_backups = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] quota_gigabytes = 1000 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] quota_groups = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] quota_snapshots = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] quota_volumes = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] rate_limit_burst = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] rate_limit_except_level = CRITICAL {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] rate_limit_interval = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Starting volume driver QuobyteDriver (1.2) Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] reinit_driver_count = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88251) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] replication_device = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] report_discard_supported = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] report_interval = 120 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] reservation_clean_interval = 86400 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] reservation_expire = 86400 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] reserved_image_namespaces = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] reserved_percentage = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] rpc_response_timeout = 120 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] run_external_periodic_tasks = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] scst_target_driver = iscsi {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] scst_target_iqn_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_down_time = 720 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] shell_completion = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] snapshot_name_template = snapshot-%s {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] split_loggers = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] state_path = /opt/stack/data/cinder {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] storage_availability_zone = nova {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] storage_protocol = iSCSI {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] syslog_log_facility = LOG_USER {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] target_helper = lioadm {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] target_ip_address = 192.168.122.31 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] target_port = 3260 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] target_protocol = iscsi {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] target_secondary_ip_addresses = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] trace_flags = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] transport_url = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] until_refresh = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] use_chap_auth = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] use_default_quota_class = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] use_journal = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] use_json = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] use_multipath_for_image_xfer = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] use_stderr = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] use_syslog = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] verify_glance_signatures = enabled {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_api_class = cinder.volume.api.API {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_backend_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_clear = zero {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_clear_ionice = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_clear_size = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_copy_bps_limit = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_dd_blocksize = 1M {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_name_template = volume-%s {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_service_inithost_offload = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volume_usage_audit_period = month {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] zoning_mode = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_concurrency.disable_process_locking = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.auth_section = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.auth_type = password {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.auth_version = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.cache = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.certfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.include_service_catalog = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.insecure = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.interface = public {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.keyfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_password = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcache_username = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.region_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.service_type = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.backend = dogpile.cache.null {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.backend_argument = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.backend_expiration_time = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.config_prefix = cache.oslo {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.debug_cache_backend = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.enable_retry_client = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.enable_socket_keepalive = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.expiration_time = 600 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.hashclient_retry_attempts = 2 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.memcache_dead_retry = 300 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.memcache_pool_maxsize = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.memcache_sasl_enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.password = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.proxies = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.redis_db = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.redis_server = localhost:6379 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.retry_attempts = 2 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.retry_delay = 0.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.socket_keepalive_count = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.socket_keepalive_idle = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.socket_keepalive_interval = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.socket_timeout = 1.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.tls_allowed_ciphers = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.tls_cafile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.tls_certfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.tls_enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.tls_keyfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cache.username = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] coordination.backend_url = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.asyncio_connection = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.asyncio_slave_connection = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.backend = sqlalchemy {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.connection = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.connection_debug = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.connection_parameters = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.connection_recycle_time = 3600 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.connection_trace = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.db_inc_retry_interval = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.db_max_retries = 20 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.db_max_retry_interval = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.db_retry_interval = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.max_overflow = 50 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.max_pool_size = 5 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.max_retries = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.mysql_wsrep_sync_wait = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.pool_timeout = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.retry_interval = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.slave_connection = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.sqlite_synchronous = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.synchronous_reader = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] database.use_db_reconnect = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.connection_string = messaging:// {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.es_doc_type = notification {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.es_scroll_size = 10000 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.es_scroll_time = 2m {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.filter_error_trace = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.hmac_keys = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.sentinel_service_name = mymaster {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.socket_timeout = 0.1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.trace_requests = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler.trace_sqlalchemy = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler_jaeger.process_tags = {} {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler_jaeger.service_name_prefix = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] profiler_otlp.service_name_prefix = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.enforce_new_defaults = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.policy_default_rule = default {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.policy_file = policy.yaml {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] privsep_osbrick.group = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] privsep_osbrick.helper_command = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] privsep_osbrick.user = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_sys_admin.group = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_sys_admin.helper_command = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] cinder_sys_admin.user = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.auth_section = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.auth_type = password {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.cafile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.certfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.collect_timing = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.insecure = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.keyfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.send_service_user_token = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.split_loggers = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] service_user.timeout = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.auth_section = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.auth_type = password {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.certfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.collect_timing = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.insecure = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.keyfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.region_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.split_loggers = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] glance.timeout = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.backend_availability_zone = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.chap_password = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.chap_username = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.disk_geometry = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.driver_client_cert = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.driver_client_cert_key = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.driver_data_namespace = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.driver_use_ssl = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.extra_capabilities = {} {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.filter_function = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.goodness_function = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.iscsi_target_flags = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.iscsi_write_cache = on {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.iser_helper = tgtadm {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88251) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 24 15:37:12 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 24 15:37:12 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.iser_port = 3260 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_host = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_login = admin {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_mount_options = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_password = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_private_key = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_share_path = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.num_shell_tries = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Running cmd (subprocess): mount.quobyte {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.quobyte_volume_url = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.replication_device = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.report_discard_supported = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.reserved_percentage = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.target_helper = tgtadm {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.target_port = 3260 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.target_protocol = iscsi {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.trace_flags = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.unique_fqdn_network = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.use_chap_auth = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volume_backend_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volume_clear = zero {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volume_clear_ionice = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volume_clear_size = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_reports.file_event_handler = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_reports.log_dir = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.backend_availability_zone = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.backend_host = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.chap_password = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.chap_username = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.chiscsi_conf = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.disk_geometry = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.driver_client_cert = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.driver_data_namespace = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.driver_use_ssl = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.extra_capabilities = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.filter_function = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.goodness_function = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.iser_helper = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.iser_ip_address = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.iser_port = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.iser_target_prefix = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_host = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_login = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_mount_options = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_password = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_private_key = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_share_path = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_ssh_port = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.num_shell_tries = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.nvmet_port_id = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.replication_device = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.report_discard_supported = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.reserved_percentage = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.scst_target_driver = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.storage_protocol = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.target_helper = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.target_ip_address = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.target_port = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.target_prefix = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.target_protocol = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.trace_flags = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.use_chap_auth = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack quobyte-client[88260]: Reading configuration file: /etc/quobyte/client.cfg Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volume_clear = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volume_clear_size = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack quobyte-client[88260]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] QuobyteHD.volumes_dir = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.ssl = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_notifications.driver = [] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_notifications.retry = -1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] key_manager.fixed_key = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.barbican_api_version = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.barbican_endpoint = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.barbican_endpoint_type = public {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.barbican_region_name = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.cafile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.certfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.collect_timing = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.insecure = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.keyfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.number_of_retries = 60 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.retry_delay = 1 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.send_service_user_token = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.split_loggers = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.timeout = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.verify_ssl = True {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican.verify_ssl_path = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.auth_section = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.auth_type = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.cafile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.certfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.collect_timing = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.insecure = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.keyfile = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.split_loggers = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] barbican_service_user.timeout = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.approle_role_id = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.approle_secret_id = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] CMD "mount.quobyte" returned: 1 in 0.099s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.auth_method = approle {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.auth_path = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.kv_mountpoint = secret {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.kv_path = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.kv_version = 2 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.namespace = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.root_token_id = **** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.ssl_ca_crt_file = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.timeout = 60.0 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.token_file = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.token_role = None {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.use_ssl = False {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:37:12 devstack cinder-volume[88169]: DEBUG oslo_service.backend._eventlet.service [None req-d4640672-4af5-4ee5-a99c-28d9004f0d82 None None] ******************************************************************************** {{(pid=88169) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:37:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:12 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:37:12 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:37:13 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.247s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:13 devstack cinder-volume[88251]: INFO cinder.volume.driver [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Driver hasn't implemented _init_vendor_properties() Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.volume.driver [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88251) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_db.sqlalchemy.engines [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88251) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writer thread running {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.db.api [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Building query based on filter {{(pid=88251) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88251) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:13 devstack cinder-volume[88251]: INFO cinder.keymgr.migration [None req-ba3bd434-29cb-4b9a-baa4-ba9e5f38a03a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 15:37:13 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:37:13 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:37:13 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.243s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:37:13 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Driver initialization completed successfully. Jul 24 15:37:13 devstack cinder-volume[88251]: INFO cinder.manager [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Initiating service 3 cleanup Jul 24 15:37:13 devstack cinder-volume[88251]: INFO cinder.manager [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Service 3 cleanup completed. Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.service [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Creating RPC server for service cinder-volume {{(pid=88251) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.service [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88251) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 15:37:13 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:37:13 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:37:13 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:37:13 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Jul 24 15:37:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.239s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:37:13 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-307c22aa-a46b-4b21-afe1-29037a0ec41d None None] Driver post RPC initialization completed successfully. Jul 24 15:37:22 devstack cinder-volume[88169]: DEBUG dbcounter [-] [88169] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:37:23 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:37:23 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=3 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:37:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:37:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 6 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:37:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:38:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:38:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:38:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:38:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:38:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:38:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:38:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:38:34 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:38:34 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:38:35 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Jul 24 15:38:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.236s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:38:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:38:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:38:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 6 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:38:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:39:23 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:39:23 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:39:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:39:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:39:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:39:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:39:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:39:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:39:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:39:34 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:39:34 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:39:35 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Jul 24 15:39:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.314s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:39:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Flow 'volume_create_manager' (d313b505-dc24-4bd3-b647-fc1a18642c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabfdf5f-fad2-4df1-a4fb-eac9aadb20cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabfdf5f-fad2-4df1-a4fb-eac9aadb20cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-561504125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479d1586-0dd2-4900-82dc-1e1e42555f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa3c90e40514c18bbb48ea8a7023d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:40:05Z,use_quota=True,user_id='46803aae6e6f4b02b63233c5ef259276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c820650-b8cc-4a82-b738-80ad1257fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c820650-b8cc-4a82-b738-80ad1257fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f60cd9f-d3b8-49df-8059-221f9cf97d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f60cd9f-d3b8-49df-8059-221f9cf97d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479d1586-0dd2-4900-82dc-1e1e42555f59', 'volume_name': 'volume-479d1586-0dd2-4900-82dc-1e1e42555f59', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76bd6b26-1e56-4509-adb7-51a40528319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76bd6b26-1e56-4509-adb7-51a40528319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1effc912-7d8c-4cb5-acca-021df1ad8139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Volume 479d1586-0dd2-4900-82dc-1e1e42555f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479d1586-0dd2-4900-82dc-1e1e42555f59', 'volume_size': 1} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-561504125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479d1586-0dd2-4900-82dc-1e1e42555f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa3c90e40514c18bbb48ea8a7023d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:40:05Z,use_quota=True,user_id='46803aae6e6f4b02b63233c5ef259276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Creating volume 479d1586-0dd2-4900-82dc-1e1e42555f59 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:40:05 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:40:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:05 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 1073741824 Jul 24 15:40:05 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:07 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 1073741824" returned: 0 in 1.367s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:07 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 Jul 24 15:40:07 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:08 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59" returned: 0 in 1.085s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] <== create_volume: return (2599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:40:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.602s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1effc912-7d8c-4cb5-acca-021df1ad8139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479d1586-0dd2-4900-82dc-1e1e42555f59', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e3dad6-ec3b-400c-8e8a-ca13a0b3122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:08 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Volume volume-479d1586-0dd2-4900-82dc-1e1e42555f59 (479d1586-0dd2-4900-82dc-1e1e42555f59): created successfully Jul 24 15:40:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e3dad6-ec3b-400c-8e8a-ca13a0b3122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Flow 'volume_create_manager' (d313b505-dc24-4bd3-b647-fc1a18642c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:40:08 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5d701ab6-fa1e-44bf-964f-4cc902c2d7ab tempest-DeleteServersTestJSON-1341646589 None] Created volume successfully. Jul 24 15:40:18 devstack cinder-volume[88251]: WARNING py.warnings [req-840fd473-e543-4a93-b662-cde10872ea93 req-33d27349-960b-4993-90cd-dd412d8d8396 tempest-DeleteServersTestJSON-1341646589 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 24 15:40:18 devstack cinder-volume[88251]: .first() Jul 24 15:40:18 devstack cinder-volume[88251]: Jul 24 15:40:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-840fd473-e543-4a93-b662-cde10872ea93 req-33d27349-960b-4993-90cd-dd412d8d8396 tempest-DeleteServersTestJSON-1341646589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-840fd473-e543-4a93-b662-cde10872ea93 req-33d27349-960b-4993-90cd-dd412d8d8396 tempest-DeleteServersTestJSON-1341646589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-840fd473-e543-4a93-b662-cde10872ea93 req-33d27349-960b-4993-90cd-dd412d8d8396 tempest-DeleteServersTestJSON-1341646589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-840fd473-e543-4a93-b662-cde10872ea93 req-33d27349-960b-4993-90cd-dd412d8d8396 tempest-DeleteServersTestJSON-1341646589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-479d1586-0dd2-4900-82dc-1e1e42555f59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9afd2a1-76bb-4c6d-8de4-b0a8a330586b', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:40:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-840fd473-e543-4a93-b662-cde10872ea93 req-33d27349-960b-4993-90cd-dd412d8d8396 tempest-DeleteServersTestJSON-1341646589 None] attachment_update completed successfully. Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Flow 'volume_create_manager' (d3c47cc6-fbcf-4dbf-8ed3-98537417edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15715f24-174e-43d4-816c-d74949317e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15715f24-174e-43d4-816c-d74949317e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-121169724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fe2abb-362e-4daf-bd46-64c80d0304c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5860774e843cfa02a83d550280fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:40:19Z,use_quota=True,user_id='b22bbc4638414d368a8df1fbf14333e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6668f16e-4493-4d2f-bc12-c043c819f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6668f16e-4493-4d2f-bc12-c043c819f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db2b26f-1bf2-4df9-b040-ef27d243d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db2b26f-1bf2-4df9-b040-ef27d243d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fe2abb-362e-4daf-bd46-64c80d0304c3', 'volume_name': 'volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c76011-72bf-4882-a568-31810081f419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c76011-72bf-4882-a568-31810081f419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618aebaf-56dc-480f-809a-83c285b6d52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:19 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Volume a4fe2abb-362e-4daf-bd46-64c80d0304c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3', 'volume_size': 1} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-121169724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fe2abb-362e-4daf-bd46-64c80d0304c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5860774e843cfa02a83d550280fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:40:19Z,use_quota=True,user_id='b22bbc4638414d368a8df1fbf14333e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Creating volume a4fe2abb-362e-4daf-bd46-64c80d0304c3 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:40:19 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:40:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:19 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 1073741824 Jul 24 15:40:19 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:20 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 1073741824" returned: 0 in 1.166s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:20 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 Jul 24 15:40:20 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:21 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3" returned: 0 in 0.481s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:40:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618aebaf-56dc-480f-809a-83c285b6d52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6222ad-a267-4070-ad5c-2d38d29a4140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Volume volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 (a4fe2abb-362e-4daf-bd46-64c80d0304c3): created successfully Jul 24 15:40:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6222ad-a267-4070-ad5c-2d38d29a4140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Flow 'volume_create_manager' (d3c47cc6-fbcf-4dbf-8ed3-98537417edd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:40:21 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-158be90b-279c-4ffe-92f6-99390288f030 tempest-VolumesAdminNegativeTest-1429597799 None] Created volume successfully. Jul 24 15:40:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Acquiring lock "cinder-a4fe2abb-362e-4daf-bd46-64c80d0304c3-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:40:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "cinder-a4fe2abb-362e-4daf-bd46-64c80d0304c3-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:40:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Acquiring lock "cinder-quobyte-a4fe2abb-362e-4daf-bd46-64c80d0304c3" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:40:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "cinder-quobyte-a4fe2abb-362e-4daf-bd46-64c80d0304c3" acquired by "delete_volume" :: waited 0.058s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:40:23 devstack cinder-volume[88251]: INFO oslo.privsep.daemon [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1_fa2ljw/privsep.sock'] Jul 24 15:40:23 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1_fa2ljw/privsep.sock Jul 24 15:40:23 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: Jul 24 15:40:25 devstack cinder-volume[88251]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 24 15:40:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-715c18ec-521a-4056-b66b-a964fb362154 req-68f11f79-b8b0-46b3-855e-4c26d9c2b967 tempest-DeleteServersTestJSON-1341646589 None] Terminate volume connection completed successfully. Jul 24 15:40:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-715c18ec-521a-4056-b66b-a964fb362154 req-68f11f79-b8b0-46b3-855e-4c26d9c2b967 tempest-DeleteServersTestJSON-1341646589 None] Deleting attachment d9afd2a1-76bb-4c6d-8de4-b0a8a330586b. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:40:25 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:25 devstack cinder-volume[88251]: INFO oslo.privsep.daemon [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Spawned new privsep daemon via rootwrap Jul 24 15:40:25 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Accepted privsep connection to /tmp/tmp1_fa2ljw/privsep.sock {{(pid=88251) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 24 15:40:25 devstack cinder-volume[88251]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 24 15:40:25 devstack cinder-volume[88251]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 24 15:40:25 devstack cinder-volume[88251]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 24 15:40:25 devstack cinder-volume[88251]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90409 Jul 24 15:40:25 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cdc995-8ad8-4919-920b-852ce027de42]: (2,) {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:40:25 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[038e1cfa-457a-41ce-b75a-4c0f5c4be1a0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:40:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:26 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 Jul 24 15:40:26 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:26 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3" returned: 0 in 0.706s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:26 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3 Jul 24 15:40:26 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Flow 'volume_create_manager' (a2c83f75-6c8c-45f6-a7eb-03ce3dfce9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695595fc-5107-4bb5-bdef-686b106ca7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695595fc-5107-4bb5-bdef-686b106ca7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-282580630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6dbd25f-1ec1-40ae-adac-e1c2c01a3354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5c34c433c54a7bbbedb61daa40b718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:40:27Z,use_quota=True,user_id='15c95842a0254b47a9bc1cd9ef4c6cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a30507-7a84-4321-aab5-0a761fc3c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a30507-7a84-4321-aab5-0a761fc3c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e50f83-2818-4b9b-852c-d83e18fbea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e50f83-2818-4b9b-852c-d83e18fbea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6dbd25f-1ec1-40ae-adac-e1c2c01a3354', 'volume_name': 'volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94166740-5e93-4fc4-a12e-22fcdbd9aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94166740-5e93-4fc4-a12e-22fcdbd9aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae80330b-6718-4297-abf3-31d0ecd33f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:27 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Volume e6dbd25f-1ec1-40ae-adac-e1c2c01a3354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354', 'volume_size': 1} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-282580630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6dbd25f-1ec1-40ae-adac-e1c2c01a3354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5c34c433c54a7bbbedb61daa40b718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:40:27Z,use_quota=True,user_id='15c95842a0254b47a9bc1cd9ef4c6cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Creating volume e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:40:27 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:27 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fe2abb-362e-4daf-bd46-64c80d0304c3" returned: 0 in 0.902s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:27 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 1073741824 Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "cinder-quobyte-a4fe2abb-362e-4daf-bd46-64c80d0304c3" released by "delete_volume" :: held 4.022s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:40:27 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:27 devstack cinder-volume[88251]: WARNING cinder.quota [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:40:27 devstack cinder-volume[88251]: WARNING cinder.quota [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Created reservations ['69a37e2a-20b5-49f2-bc94-d3c94fe06354', '40dcc1f3-2c27-464f-827e-9be9d3ca22f1', '5f7c3e88-ee22-4963-bc2d-67857bdc705a', 'f1367b2b-92a8-486c-958c-c41b835fef33'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:27 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:40:27 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:28 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.642s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:28 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:40:28 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 1073741824" returned: 0 in 1.064s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Deleted volume successfully. Jul 24 15:40:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e828eb25-7a33-4a5c-8a6b-a097fd28e6b3 tempest-VolumesAdminNegativeTest-1429597799 None] Lock "cinder-a4fe2abb-362e-4daf-bd46-64c80d0304c3-delete_volume" released by "delete_volume" :: held 5.695s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:40:28 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 Jul 24 15:40:28 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Acquiring lock "cinder-479d1586-0dd2-4900-82dc-1e1e42555f59-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Lock "cinder-479d1586-0dd2-4900-82dc-1e1e42555f59-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Acquiring lock "cinder-quobyte-479d1586-0dd2-4900-82dc-1e1e42555f59" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Lock "cinder-quobyte-479d1586-0dd2-4900-82dc-1e1e42555f59" acquired by "delete_volume" :: waited 0.046s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bc0467-d6cc-4106-ba14-6a20bee2ff33]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:29 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354" returned: 0 in 0.653s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae80330b-6718-4297-abf3-31d0ecd33f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548b58a7-84ca-47cf-8864-2de884045f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:40:29 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Volume volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 (e6dbd25f-1ec1-40ae-adac-e1c2c01a3354): created successfully Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548b58a7-84ca-47cf-8864-2de884045f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:40:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Flow 'volume_create_manager' (a2c83f75-6c8c-45f6-a7eb-03ce3dfce9ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:40:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2c090142-af11-4af7-aca5-79b93b74788f tempest-ServerRescueNegativeTestJSON-890385186 None] Created volume successfully. Jul 24 15:40:29 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 Jul 24 15:40:29 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:30 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59" returned: 0 in 0.832s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:30 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59 Jul 24 15:40:30 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:30 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-479d1586-0dd2-4900-82dc-1e1e42555f59" returned: 0 in 0.725s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Lock "cinder-quobyte-479d1586-0dd2-4900-82dc-1e1e42555f59" released by "delete_volume" :: held 1.641s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:40:31 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Created reservations ['5ab4b364-d248-49ff-9cbb-5d779af7b671', '3efa08f7-978d-4d3a-ab18-431218192b2c', 'b2bdf2b9-c6cb-49ea-b2c9-54e0dd7a2000', '6277114e-3c80-45f5-ab03-e7e1de45548c'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:40:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:40:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:40:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:31 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:40:31 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:32 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.636s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:32 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:40:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Deleted volume successfully. Jul 24 15:40:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32379223-af88-4b05-baf4-0c02d23ce674 tempest-DeleteServersTestJSON-1341646589 None] Lock "cinder-479d1586-0dd2-4900-82dc-1e1e42555f59-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:40:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:40:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:40:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:40:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:40:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:40:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:40:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:34 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:40:34 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:35 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.728s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:40:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:40:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 8 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:40:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:40:41 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=28,cinder:SELECT=29,cinder:DELETE=2,cinder:INSERT=3 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:40:42 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=18,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=3 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:40:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Acquiring lock "cinder-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:40:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "cinder-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:40:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Acquiring lock "cinder-quobyte-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:40:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "cinder-quobyte-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354" acquired by "delete_volume" :: waited 0.033s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:40:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee76ec4-04b3-4609-abf9-5868b3abf914]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:40:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:59 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 Jul 24 15:40:59 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:59 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354" returned: 0 in 0.536s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:59 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354 Jul 24 15:40:59 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:00 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354" returned: 0 in 0.405s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "cinder-quobyte-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354" released by "delete_volume" :: held 1.029s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Created reservations ['987f7bcf-edac-4473-a87b-bb410e92f2fa', 'b0bbd12a-30f5-44f5-b5da-fbe34154e43b', '7a57325c-ba51-4947-90bc-f0c915d4761e', '8c1317ad-6c23-4c81-8415-c9930ef9fbd0'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:00 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:41:00 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:01 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.810s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:01 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:41:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Deleted volume successfully. Jul 24 15:41:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-682c1afc-98aa-47f7-a323-05f9ef52f65b tempest-ServerRescueNegativeTestJSON-890385186 None] Lock "cinder-e6dbd25f-1ec1-40ae-adac-e1c2c01a3354-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:41:10 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:41:11 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=12,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:41:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ca16ded6-a8cb-4315-95a8-8630ebc29423 tempest-GroupSnapshotsV319Test-1243604736 None] Group tempest-GroupSnapshotsV319Test-Group-1303259440: creating Jul 24 15:41:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ca16ded6-a8cb-4315-95a8-8630ebc29423 tempest-GroupSnapshotsV319Test-1243604736 None] Group tempest-GroupSnapshotsV319Test-Group-1303259440: created successfully Jul 24 15:41:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ca16ded6-a8cb-4315-95a8-8630ebc29423 tempest-GroupSnapshotsV319Test-1243604736 None] Create group completed successfully. Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Flow 'volume_create_manager' (6a02c346-af78-453a-b52f-16c0dd436704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0002c7-5773-4c92-b5f1-7119c6984a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0002c7-5773-4c92-b5f1-7119c6984a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750015518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e82772e4-9481-432e-90d4-c65153935ec5,host='devstack@QuobyteHD#QuobyteHD',id=45c71328-9655-4c74-b606-3cab62e9a73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c70762a0d84e508ce2185552788824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:26Z,use_quota=True,user_id='e7a53f176cfa431786b70b971621341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4402d78-a91c-4632-9bcc-e257dfcfade2),volume_type_id=f4402d78-a91c-4632-9bcc-e257dfcfade2)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9aac98-3b1b-498c-ac24-226aaa92e476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9aac98-3b1b-498c-ac24-226aaa92e476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d932406-4a25-4db6-afcd-eed1d89c6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d932406-4a25-4db6-afcd-eed1d89c6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c71328-9655-4c74-b606-3cab62e9a73c', 'volume_name': 'volume-45c71328-9655-4c74-b606-3cab62e9a73c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44acce69-0a18-4505-b457-238e29627d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44acce69-0a18-4505-b457-238e29627d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43c1130-619a-47a5-85bb-8a22f9af89aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Volume 45c71328-9655-4c74-b606-3cab62e9a73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c71328-9655-4c74-b606-3cab62e9a73c', 'volume_size': 1} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e82772e4-9481-432e-90d4-c65153935ec5,created_at=2026-07-24T13:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750015518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e82772e4-9481-432e-90d4-c65153935ec5,host='devstack@QuobyteHD#QuobyteHD',id=45c71328-9655-4c74-b606-3cab62e9a73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c70762a0d84e508ce2185552788824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:26Z,use_quota=True,user_id='e7a53f176cfa431786b70b971621341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4402d78-a91c-4632-9bcc-e257dfcfade2),volume_type_id=f4402d78-a91c-4632-9bcc-e257dfcfade2)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Creating volume 45c71328-9655-4c74-b606-3cab62e9a73c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:41:25 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:41:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:26 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c 1073741824 Jul 24 15:41:26 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:26 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c 1073741824" returned: 0 in 0.744s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:26 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c Jul 24 15:41:26 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:27 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c" returned: 0 in 0.691s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:41:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43c1130-619a-47a5-85bb-8a22f9af89aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c71328-9655-4c74-b606-3cab62e9a73c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4533a07d-e88f-4d44-8dd4-fcad51c4cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:27 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Volume volume-45c71328-9655-4c74-b606-3cab62e9a73c (45c71328-9655-4c74-b606-3cab62e9a73c): created successfully Jul 24 15:41:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4533a07d-e88f-4d44-8dd4-fcad51c4cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Flow 'volume_create_manager' (6a02c346-af78-453a-b52f-16c0dd436704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5ead15b9-6805-4c6c-85c2-aa4f55f6c329 tempest-GroupSnapshotsV319Test-1243604736 None] Created volume successfully. Jul 24 15:41:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] GroupSnapshot e1390eee-c163-498e-a02c-041bc22634b2: creating. Jul 24 15:41:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Group snapshot e1390eee-c163-498e-a02c-041bc22634b2: creating. {{(pid=88251) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 15:41:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Creating offline snapshot 1fb15316-13b7-4a2b-a5e1-f074d5d4857a of volume 45c71328-9655-4c74-b606-3cab62e9a73c {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:41:29 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbce966-8965-4035-8b9c-c834b17c447f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:29 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c Jul 24 15:41:29 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:30 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c" returned: 0 in 0.777s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:30 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a 1G Jul 24 15:41:30 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:31 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a 1G" returned: 0 in 0.579s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c71328-9655-4c74-b606-3cab62e9a73c -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:31 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c71328-9655-4c74-b606-3cab62e9a73c -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a Jul 24 15:41:31 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:31 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c71328-9655-4c74-b606-3cab62e9a73c -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a" returned: 0 in 0.484s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:31 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:41:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:31 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a Jul 24 15:41:31 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:31 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a" returned: 0 in 0.364s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:32 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.info Jul 24 15:41:32 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:32 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.info" returned: 0 in 0.309s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:32 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:41:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:32 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.info Jul 24 15:41:32 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:32 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.info" returned: 0 in 0.314s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.940s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-883f83ba-ded9-44b5-a61a-5108323a26d1 tempest-GroupSnapshotsV319Test-1243604736 None] group_snapshot e1390eee-c163-498e-a02c-041bc22634b2: created successfully Jul 24 15:41:33 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] group_snapshot e1390eee-c163-498e-a02c-041bc22634b2: deleting Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] group_snapshot e1390eee-c163-498e-a02c-041bc22634b2: deleting {{(pid=88251) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Acquiring lock "cinder-quobyte-45c71328-9655-4c74-b606-3cab62e9a73c" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "cinder-quobyte-45c71328-9655-4c74-b606-3cab62e9a73c" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Acquiring lock "cinder-quobyte-1fb15316-13b7-4a2b-a5e1-f074d5d4857a" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "cinder-quobyte-1fb15316-13b7-4a2b-a5e1-f074d5d4857a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Deleting offline snapshot 1fb15316-13b7-4a2b-a5e1-f074d5d4857a of volume 45c71328-9655-4c74-b606-3cab62e9a73c {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] snapshot_file for this snap is: volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb29480-e2f8-4380-8056-307383275745]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:33 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a Jul 24 15:41:33 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:34 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a" returned: 0 in 0.532s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c71328-9655-4c74-b606-3cab62e9a73c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda87009-d439-4b96-ab2a-4661c8bc1408]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:34 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c Jul 24 15:41:34 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:34 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:34 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c" returned: 0 in 0.475s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:34 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:34 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a Jul 24 15:41:34 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:35 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.356s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 8 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:41:35 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a" returned: 0 in 0.476s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:35 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a Jul 24 15:41:35 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:35 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c.1fb15316-13b7-4a2b-a5e1-f074d5d4857a" returned: 0 in 0.249s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "cinder-quobyte-1fb15316-13b7-4a2b-a5e1-f074d5d4857a" released by "_delete_snapshot" :: held 1.865s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Lock "cinder-quobyte-45c71328-9655-4c74-b606-3cab62e9a73c" released by "delete_snapshot" :: held 1.906s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:41:35 devstack cinder-volume[88251]: WARNING cinder.quota [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-902766175 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-902766175, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:41:35 devstack cinder-volume[88251]: WARNING cinder.quota [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-902766175 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-902766175, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:41:35 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] Created reservations ['6d7b95c0-75b9-417c-8679-0cd0402bb172', 'd0fa9601-8f89-420b-bbf2-051fdf436347', '4e5fc5e2-727b-404f-bb08-8610bafdda7f', 'ceef34d0-434d-4194-92ec-4e9ff42dfa2f'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:41:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1be1d80d-4a9b-4c33-b7e7-4f7e68c94a66 tempest-GroupSnapshotsV319Test-1243604736 None] group_snapshot e1390eee-c163-498e-a02c-041bc22634b2: deleted successfully Jul 24 15:41:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Acquiring lock "cinder-quobyte-45c71328-9655-4c74-b606-3cab62e9a73c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:41:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Lock "cinder-quobyte-45c71328-9655-4c74-b606-3cab62e9a73c" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:41:36 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd0851b-8cb9-4e6d-92cc-71d3c54b7bd2]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:37 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c Jul 24 15:41:37 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:37 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c" returned: 0 in 0.409s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:37 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c Jul 24 15:41:37 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:37 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-45c71328-9655-4c74-b606-3cab62e9a73c" returned: 0 in 0.252s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Lock "cinder-quobyte-45c71328-9655-4c74-b606-3cab62e9a73c" released by "delete_volume" :: held 0.763s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Created reservations ['1db80fda-bada-4dcc-9e9c-30f8e78b1aea'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:41:37 devstack cinder-volume[88251]: WARNING cinder.quota [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-902766175 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-902766175, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Created reservations ['7218f276-126c-4fa2-b937-14b95945fc85', 'bad251d4-6f13-4a0d-9541-f4de68f25993', 'aa8a5733-7797-4721-acbd-838a4a6ba6e4', '59df6875-da39-4e34-b72d-2d3b6cba638f'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:37 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:41:37 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:38 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.266s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:38 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:41:38 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-91fb9306-b9d4-4065-9fe0-b57ccb036dce tempest-GroupSnapshotsV319Test-1243604736 None] Delete group completed successfully. Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Flow 'volume_create_manager' (824e0888-53cd-4462-a314-9a3971a83d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cf533f-d556-4a9f-abab-b767b3dd4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cf533f-d556-4a9f-abab-b767b3dd4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1144978259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3409a0-6a6f-49fe-8c97-fd22e66bf62f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d60da32dcb4894a22e79a20c336659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:44Z,use_quota=True,user_id='7c90c6bbbe084b44968e33d0c2cd0a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e941f41d-3e81-4b3e-a943-b7502472a1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e941f41d-3e81-4b3e-a943-b7502472a1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921dad2d-0f0b-4c3a-b812-d571b5e1757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921dad2d-0f0b-4c3a-b812-d571b5e1757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3409a0-6a6f-49fe-8c97-fd22e66bf62f', 'volume_name': 'volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e639cd16-5334-4da7-a457-86aaa3f9f6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e639cd16-5334-4da7-a457-86aaa3f9f6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d969df-809a-4e10-b397-5c8acac12f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:44 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f', 'volume_size': 1} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1144978259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3409a0-6a6f-49fe-8c97-fd22e66bf62f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d60da32dcb4894a22e79a20c336659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:44Z,use_quota=True,user_id='7c90c6bbbe084b44968e33d0c2cd0a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Creating volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:41:44 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:44 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f 1073741824 Jul 24 15:41:44 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:44 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f 1073741824" returned: 0 in 0.541s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:44 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f Jul 24 15:41:44 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:45 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" returned: 0 in 0.361s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:41:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d969df-809a-4e10-b397-5c8acac12f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929581fb-5df3-4e68-bfe7-524571148786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:45 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Volume volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f (5d3409a0-6a6f-49fe-8c97-fd22e66bf62f): created successfully Jul 24 15:41:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929581fb-5df3-4e68-bfe7-524571148786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Flow 'volume_create_manager' (824e0888-53cd-4462-a314-9a3971a83d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-80014eda-0291-403a-b48a-9732422814dc tempest-SnapshotsActionsTest-1209052756 None] Created volume successfully. Jul 24 15:41:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Creating offline snapshot 05e18762-401b-4b72-876f-13e400bf9975 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:41:46 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9e9961-d7d4-4eec-acf0-684b12b9743d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:46 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f Jul 24 15:41:46 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:47 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" returned: 0 in 0.542s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:47 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 1G Jul 24 15:41:47 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Flow 'volume_create_manager' (04421e20-521e-4eca-95e3-b9a7df3ef503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05cfaeba-1429-46e2-a8b8-9a23de167d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05cfaeba-1429-46e2-a8b8-9a23de167d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-684938787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb81f3b-6b04-4a52-9319-5ce2f43eef85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b612e892812b43e68c183a36f1965f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:47Z,use_quota=True,user_id='63741b5f41094950a83b44913695a76a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe038c05-2ddb-43b7-9595-54dc365397a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe038c05-2ddb-43b7-9595-54dc365397a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b8c5de-3d24-400f-a022-fe45a72e0b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b8c5de-3d24-400f-a022-fe45a72e0b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb81f3b-6b04-4a52-9319-5ce2f43eef85', 'volume_name': 'volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c20200-81f6-4f35-8498-7dad73ef52d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c20200-81f6-4f35-8498-7dad73ef52d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22ec20e-29d7-415d-acea-01a84fda3d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Volume edb81f3b-6b04-4a52-9319-5ce2f43eef85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85', 'volume_size': 1} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Flow 'volume_create_manager' (0608d126-ac2d-42cb-8042-ef1228c6b65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627d3de3-c542-43bd-9f5b-20f9d21a78ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627d3de3-c542-43bd-9f5b-20f9d21a78ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-813346023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a402f00426f747c1a03cb580558d7bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:47Z,use_quota=True,user_id='73e1d2cd37134f66949c757611ce78c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73035fb9-e20d-444b-ac32-d6effa0cd665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73035fb9-e20d-444b-ac32-d6effa0cd665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6205410-a485-4d98-adba-832ab3400de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6205410-a485-4d98-adba-832ab3400de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e', 'volume_name': 'volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e42e83f-9357-4e10-bfe8-6a7ecdd8a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e42e83f-9357-4e10-bfe8-6a7ecdd8a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d307b7d2-a61a-4239-a7f9-0f91903c7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:47 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Volume 5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e', 'volume_size': 1} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:47 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 1G" returned: 0 in 0.542s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:47 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:41:47 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:48 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.342s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:48 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 is being set with open permissions: ugo+rw Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:48 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:41:48 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:48 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.290s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:48 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.info Jul 24 15:41:48 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:48 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.info" returned: 0 in 0.269s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:48 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.info is being set with open permissions: ugo+rw Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:48 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.info Jul 24 15:41:48 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:48 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.info" returned: 0 in 0.236s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-684938787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb81f3b-6b04-4a52-9319-5ce2f43eef85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b612e892812b43e68c183a36f1965f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:47Z,use_quota=True,user_id='63741b5f41094950a83b44913695a76a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Creating volume edb81f3b-6b04-4a52-9319-5ce2f43eef85 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:41:48 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:41:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:48 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 1073741824 Jul 24 15:41:48 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-15b4cd84-34a7-417e-9da5-2f51c640bccb tempest-SnapshotsActionsTest-1209052756 None] Create snapshot completed successfully Jul 24 15:41:49 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 1073741824" returned: 0 in 0.462s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:49 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 Jul 24 15:41:49 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:49 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85" returned: 0 in 0.262s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-813346023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a402f00426f747c1a03cb580558d7bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:47Z,use_quota=True,user_id='73e1d2cd37134f66949c757611ce78c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Creating volume 5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:41:49 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22ec20e-29d7-415d-acea-01a84fda3d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f292ee-cf17-43bd-aa9b-7b1eaed9d189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:49 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e 1073741824 Jul 24 15:41:49 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Volume volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 (edb81f3b-6b04-4a52-9319-5ce2f43eef85): created successfully Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f292ee-cf17-43bd-aa9b-7b1eaed9d189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Flow 'volume_create_manager' (04421e20-521e-4eca-95e3-b9a7df3ef503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-581070f8-b16e-4a38-8936-ecef18f61185 tempest-TaggedAttachmentsTest-1228566648 None] Created volume successfully. Jul 24 15:41:50 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e 1073741824" returned: 0 in 0.582s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:50 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e Jul 24 15:41:50 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:41:50 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Flow 'volume_create_manager' (6720fe94-7b98-459c-9cb0-39e972d114f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0269f98c-83cb-4d2e-b98f-58d0b104ea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e" returned: 0 in 0.409s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0269f98c-83cb-4d2e-b98f-58d0b104ea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-965018109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83368341-fb93-468d-8ab8-78545dec577a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec511163a17b4425bf41cacddc5d39e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:51Z,use_quota=True,user_id='4d972d92509440f58c2ce1525358f259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aabd127-13fb-4dfa-9927-9c18f9637f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aabd127-13fb-4dfa-9927-9c18f9637f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bbc203-90c8-4d52-9235-a8103d98dc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bbc203-90c8-4d52-9235-a8103d98dc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83368341-fb93-468d-8ab8-78545dec577a', 'volume_name': 'volume-83368341-fb93-468d-8ab8-78545dec577a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4f6dc6-8227-4c6b-9a9f-05bcee41ae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4f6dc6-8227-4c6b-9a9f-05bcee41ae6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233c34b4-9496-4c55-b38d-e261f4232d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Volume 83368341-fb93-468d-8ab8-78545dec577a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83368341-fb93-468d-8ab8-78545dec577a', 'volume_size': 1} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-965018109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83368341-fb93-468d-8ab8-78545dec577a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec511163a17b4425bf41cacddc5d39e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:41:51Z,use_quota=True,user_id='4d972d92509440f58c2ce1525358f259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Creating volume 83368341-fb93-468d-8ab8-78545dec577a {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:41:50 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d307b7d2-a61a-4239-a7f9-0f91903c7654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab158cc-d13b-4b01-baaa-6018476b667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:50 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a 1073741824 Jul 24 15:41:50 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Volume volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e (5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e): created successfully Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab158cc-d13b-4b01-baaa-6018476b667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Flow 'volume_create_manager' (0608d126-ac2d-42cb-8042-ef1228c6b65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-22e5fbc4-a7f5-41b4-b849-f5bbedcb08eb tempest-ServerActionsTestOtherA-73505067 None] Created volume successfully. Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:51 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a 1073741824" returned: 0 in 0.630s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:51 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a Jul 24 15:41:51 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:51 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a" returned: 0 in 0.354s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.817s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233c34b4-9496-4c55-b38d-e261f4232d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83368341-fb93-468d-8ab8-78545dec577a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a79cc2b9-2180-4245-a1f1-ebec145c0486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Creating offline snapshot fb4e66a1-dda7-403d-828a-df8ab2355661 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:41:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Volume volume-83368341-fb93-468d-8ab8-78545dec577a (83368341-fb93-468d-8ab8-78545dec577a): created successfully Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a79cc2b9-2180-4245-a1f1-ebec145c0486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Flow 'volume_create_manager' (6720fe94-7b98-459c-9cb0-39e972d114f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb720d6f-406e-40ec-8203-1e1fbc27d740]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0afa8c3b-751e-44dd-8369-b1a16fcd29e7 tempest-AttachVolumeShelveTestJSON-1682236205 None] Created volume successfully. Jul 24 15:41:52 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:41:52 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:52 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.481s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:41:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:52 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 1G Jul 24 15:41:52 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:53 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 1G" returned: 0 in 0.660s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:53 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 Jul 24 15:41:53 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:53 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661" returned: 0 in 0.415s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:53 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 is being set with open permissions: ugo+rw Jul 24 15:41:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:53 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 Jul 24 15:41:53 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:53 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661" returned: 0 in 0.330s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ecbed3f6-3633-4d86-9e04-6e98e6185e43 tempest-SnapshotsActionsTest-1209052756 None] Create snapshot completed successfully Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-fb4e66a1-dda7-403d-828a-df8ab2355661-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-fb4e66a1-dda7-403d-828a-df8ab2355661-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-quobyte-fb4e66a1-dda7-403d-828a-df8ab2355661" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-fb4e66a1-dda7-403d-828a-df8ab2355661" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Deleting offline snapshot fb4e66a1-dda7-403d-828a-df8ab2355661 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] snapshot_file for this snap is: volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f244e9-17c3-4479-aa4a-003b7ca6172a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:54 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 Jul 24 15:41:54 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:55 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661" returned: 0 in 0.541s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:41:55 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[50baa6f5-fe73-4378-8ce2-d07066671634]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:55 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:41:55 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:56 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.753s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:41:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:56 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 Jul 24 15:41:56 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:57 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661" returned: 0 in 0.945s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:57 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661 Jul 24 15:41:57 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:57 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fb4e66a1-dda7-403d-828a-df8ab2355661" returned: 0 in 0.314s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-fb4e66a1-dda7-403d-828a-df8ab2355661" released by "_delete_snapshot" :: held 2.740s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:41:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" released by "delete_snapshot" :: held 2.780s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:41:57 devstack cinder-volume[88251]: WARNING cinder.quota [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:41:57 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Created reservations ['698a8863-1d6f-4505-aa7f-3eebbdef6b38', 'd94410af-f466-4c5b-bc2d-5b8fd50402e2', '67aa83a8-e07b-499a-9cbf-ba57aa67ec26', '425c54c9-b2b9-43cb-85f1-fbd6b96f790b'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:41:57 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Delete snapshot completed successfully. Jul 24 15:41:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-97cb5b98-7efc-45a7-90a9-d476d76e682c tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-fb4e66a1-dda7-403d-828a-df8ab2355661-delete_snapshot" released by "delete_snapshot" :: held 3.082s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:41:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Creating offline snapshot 4e9f771d-f1ff-4217-97eb-8f3d6f112589 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:41:58 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd18f702-aa7a-4444-a014-fe527ff56040]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:41:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:58 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:41:58 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:59 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.750s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:41:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:59 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 1G Jul 24 15:41:59 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:00 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 1G" returned: 0 in 0.859s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:00 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 Jul 24 15:42:00 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:00 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589" returned: 0 in 0.805s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:00 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 is being set with open permissions: ugo+rw Jul 24 15:42:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:01 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 Jul 24 15:42:01 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:01 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589" returned: 0 in 0.469s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f82f1c54-64d8-4baa-9a43-5ce75c8d3140 tempest-SnapshotsActionsTest-1209052756 None] Create snapshot completed successfully Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-4e9f771d-f1ff-4217-97eb-8f3d6f112589-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-4e9f771d-f1ff-4217-97eb-8f3d6f112589-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-quobyte-4e9f771d-f1ff-4217-97eb-8f3d6f112589" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-4e9f771d-f1ff-4217-97eb-8f3d6f112589" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Deleting offline snapshot 4e9f771d-f1ff-4217-97eb-8f3d6f112589 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] snapshot_file for this snap is: volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d43a45-06f1-433b-a54e-c91a8fbef45d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:02 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 Jul 24 15:42:02 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:02 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589" returned: 0 in 0.514s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b32402-7f94-44a3-bb66-32fecf4f97cf]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:03 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:42:03 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:03 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.728s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:03 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 Jul 24 15:42:03 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:04 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589" returned: 0 in 0.706s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:04 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589 Jul 24 15:42:04 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:04 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.4e9f771d-f1ff-4217-97eb-8f3d6f112589" returned: 0 in 0.522s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-4e9f771d-f1ff-4217-97eb-8f3d6f112589" released by "_delete_snapshot" :: held 2.768s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" released by "delete_snapshot" :: held 2.821s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:05 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Created reservations ['7ee72194-7a89-416b-b57f-4ad7c3239e87', 'ffac36e0-6b92-486b-bbce-1f5bef9d0cd8', 'ac0fca21-6634-4857-b84c-529026c971ee', '4787f13c-eee4-441b-bd6e-76368d67d0ff'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Delete snapshot completed successfully. Jul 24 15:42:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96969d09-a58d-464d-9681-e290dc6bcb6d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-4e9f771d-f1ff-4217-97eb-8f3d6f112589-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Creating offline snapshot 36717ade-f7dc-48e7-a246-0ef537036ea4 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:42:06 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da51ac6-1042-4f22-8aef-21b5be76d542]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:06 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:42:06 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:07 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.833s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:07 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 1G Jul 24 15:42:07 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:08 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 1G" returned: 0 in 1.165s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:08 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 Jul 24 15:42:08 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:08 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4" returned: 0 in 0.461s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:08 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 is being set with open permissions: ugo+rw Jul 24 15:42:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:08 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 Jul 24 15:42:08 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-84469f32-3815-430f-aa4b-1ac568d2a878 req-22de3d43-429a-4a67-bfb6-92bd7ad5b7ac tempest-AttachVolumeShelveTestJSON-1682236205 None] No connector for attachment 00c6ccc5-ff19-4828-aee2-f7210db0345a; skipping storage backend terminate_connection call. {{(pid=88251) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 24 15:42:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-84469f32-3815-430f-aa4b-1ac568d2a878 req-22de3d43-429a-4a67-bfb6-92bd7ad5b7ac tempest-AttachVolumeShelveTestJSON-1682236205 None] Deleting attachment 00c6ccc5-ff19-4828-aee2-f7210db0345a. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:42:09 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4" returned: 0 in 0.550s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.229s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9626fb16-de6c-42d8-b37c-bc0ca3b58c0e tempest-SnapshotsActionsTest-1209052756 None] Create snapshot completed successfully Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-36717ade-f7dc-48e7-a246-0ef537036ea4-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-36717ade-f7dc-48e7-a246-0ef537036ea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-quobyte-36717ade-f7dc-48e7-a246-0ef537036ea4" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-36717ade-f7dc-48e7-a246-0ef537036ea4" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Deleting offline snapshot 36717ade-f7dc-48e7-a246-0ef537036ea4 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] snapshot_file for this snap is: volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e524b5-f9a0-472d-a8cb-7e4d319e52e6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:11 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 Jul 24 15:42:11 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:11 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4" returned: 0 in 0.691s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a200d311-7f3b-4445-b6b0-82d0eac3ff01]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:11 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:42:11 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:12 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.644s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:12 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 Jul 24 15:42:12 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:12 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4" returned: 0 in 0.651s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:13 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4 Jul 24 15:42:13 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:13 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.36717ade-f7dc-48e7-a246-0ef537036ea4" returned: 0 in 0.317s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-36717ade-f7dc-48e7-a246-0ef537036ea4" released by "_delete_snapshot" :: held 2.485s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" released by "delete_snapshot" :: held 2.533s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:13 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=53,cinder:UPDATE=54,cinder:DELETE=5,cinder:INSERT=12 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:42:13 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Created reservations ['55fd063c-dc13-4900-bd30-fc5e4a4b830a', 'e8191eba-abd7-4c0f-a8d3-e76828129c1c', 'bbb78fb4-34f7-4d83-91dd-172f56292ace', 'bb5504ae-5e21-4bf5-b130-9a1a156ba337'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:13 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Delete snapshot completed successfully. Jul 24 15:42:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9f53901a-4427-4c66-9482-3bdcfb8d298d tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-36717ade-f7dc-48e7-a246-0ef537036ea4-delete_snapshot" released by "delete_snapshot" :: held 2.866s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Creating offline snapshot fc32ac16-e083-4f0e-a518-0fd6f335e528 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:42:14 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ca460e-109a-46dd-aa0f-062ec1566e5b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:14 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:42:14 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:14 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.429s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:15 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 1G Jul 24 15:42:15 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:15 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 1G" returned: 0 in 0.547s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:15 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 Jul 24 15:42:15 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:15 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528" returned: 0 in 0.360s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:15 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 is being set with open permissions: ugo+rw Jul 24 15:42:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:15 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 Jul 24 15:42:15 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:16 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528" returned: 0 in 0.455s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d5a90ff2-eae1-42f7-98f7-a7cf9785f501 tempest-SnapshotsActionsTest-1209052756 None] Create snapshot completed successfully Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-fc32ac16-e083-4f0e-a518-0fd6f335e528-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-fc32ac16-e083-4f0e-a518-0fd6f335e528-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Acquiring lock "cinder-quobyte-fc32ac16-e083-4f0e-a518-0fd6f335e528" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-fc32ac16-e083-4f0e-a518-0fd6f335e528" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Deleting offline snapshot fc32ac16-e083-4f0e-a518-0fd6f335e528 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] snapshot_file for this snap is: volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2918ebbd-942b-47a2-afb6-7faa606c9c85]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:17 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 Jul 24 15:42:17 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:17 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528" returned: 0 in 0.452s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:17 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[36579ed6-2bdc-4a2d-b576-e6563ebe7711]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:17 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:42:17 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:17 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.463s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:17 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 Jul 24 15:42:17 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:18 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528" returned: 0 in 0.412s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:18 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528 Jul 24 15:42:18 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:18 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.fc32ac16-e083-4f0e-a518-0fd6f335e528" returned: 0 in 0.276s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:18 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-fc32ac16-e083-4f0e-a518-0fd6f335e528" released by "_delete_snapshot" :: held 1.720s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:18 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" released by "delete_snapshot" :: held 1.751s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:18 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Created reservations ['9a3eaec6-d90c-43e1-8277-3714b0d4022f', '8e6cd84a-6ffb-4451-81d3-c3137a67546f', '7cf85d4f-f194-4fa7-af15-22f98d40427e', '5302470c-427b-4782-a057-88ed7f8cafe7'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Delete snapshot completed successfully. Jul 24 15:42:18 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0ba7e0b7-5c8b-41aa-9250-3aa4727ceca2 tempest-SnapshotsActionsTest-1651898841 None] Lock "cinder-fc32ac16-e083-4f0e-a518-0fd6f335e528-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "cinder-05e18762-401b-4b72-876f-13e400bf9975-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-05e18762-401b-4b72-876f-13e400bf9975-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "cinder-quobyte-05e18762-401b-4b72-876f-13e400bf9975" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-quobyte-05e18762-401b-4b72-876f-13e400bf9975" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Deleting offline snapshot 05e18762-401b-4b72-876f-13e400bf9975 of volume 5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] snapshot_file for this snap is: volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[541de93c-e665-4e9e-8d53-d7be76e98d7f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:19 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:42:19 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:20 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.459s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:42:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c226f9b-ccbc-4f1a-8599-f72bb2850af2]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:20 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f Jul 24 15:42:20 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:20 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" returned: 0 in 0.586s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:20 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:42:20 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:21 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.566s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:21 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975 Jul 24 15:42:21 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:22 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f.05e18762-401b-4b72-876f-13e400bf9975" returned: 0 in 0.660s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:22 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=61,cinder:SELECT=71,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:42:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-quobyte-05e18762-401b-4b72-876f-13e400bf9975" released by "_delete_snapshot" :: held 2.506s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" released by "delete_snapshot" :: held 2.567s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:22 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Created reservations ['304115f0-cf45-4dab-9eba-7d074d2eaac2', 'ed2112bf-0143-43ed-8c29-2ee476dd6660', 'ab8b40a5-f93c-427f-949e-774b0c5224d8', 'f2fe51d5-2af8-4ca9-82ee-3c2a4ae93983'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:22 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Delete snapshot completed successfully. Jul 24 15:42:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5173b129-ce73-4dc4-a829-76799c864090 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-05e18762-401b-4b72-876f-13e400bf9975-delete_snapshot" released by "delete_snapshot" :: held 2.950s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "cinder-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:23 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9222d-f863-43e5-8b31-bc6fe37cd8d8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:23 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f Jul 24 15:42:23 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:23 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" returned: 0 in 0.440s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:23 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f Jul 24 15:42:23 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:24 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" returned: 0 in 0.434s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-quobyte-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f" released by "delete_volume" :: held 0.953s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ee10aaa5-2ec4-4a8a-b3bf-837460f37a91 req-82bb7175-092e-40f7-aa56-53235154bbd5 tempest-ServerActionsTestOtherA-73505067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ee10aaa5-2ec4-4a8a-b3bf-837460f37a91 req-82bb7175-092e-40f7-aa56-53235154bbd5 tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ee10aaa5-2ec4-4a8a-b3bf-837460f37a91 req-82bb7175-092e-40f7-aa56-53235154bbd5 tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Created reservations ['e73204b5-af06-4684-b867-213871076001', '3873bfcb-e4b7-4254-94f1-22b61161bd7a', '398d31c0-83d0-480c-a968-5c646c76ff4f', '1f8385d3-8ed7-45ff-a09c-c58825e3f567'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-ee10aaa5-2ec4-4a8a-b3bf-837460f37a91 req-82bb7175-092e-40f7-aa56-53235154bbd5 tempest-ServerActionsTestOtherA-73505067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e69f35e-b79d-45f7-b8f2-b5bb8d46b64d', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:42:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-ee10aaa5-2ec4-4a8a-b3bf-837460f37a91 req-82bb7175-092e-40f7-aa56-53235154bbd5 tempest-ServerActionsTestOtherA-73505067 None] attachment_update completed successfully. Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:24 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:42:24 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:24 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.399s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:42:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Deleted volume successfully. Jul 24 15:42:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2f979571-b409-40af-aaea-c5fd185726b5 tempest-SnapshotsActionsTest-1209052756 None] Lock "cinder-5d3409a0-6a6f-49fe-8c97-fd22e66bf62f-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-2d73fae6-069a-403d-b782-98abf5cc7926 req-722fa66e-1ce7-49d5-9817-0fca2b66df78 tempest-ServerActionsTestOtherA-73505067 None] Terminate volume connection completed successfully. Jul 24 15:42:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-2d73fae6-069a-403d-b782-98abf5cc7926 req-722fa66e-1ce7-49d5-9817-0fca2b66df78 tempest-ServerActionsTestOtherA-73505067 None] Deleting attachment 8e69f35e-b79d-45f7-b8f2-b5bb8d46b64d. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:42:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-2d73fae6-069a-403d-b782-98abf5cc7926 req-eedd0508-9a4c-4a94-b401-80e5397ab8c4 tempest-ServerActionsTestOtherA-73505067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-2d73fae6-069a-403d-b782-98abf5cc7926 req-eedd0508-9a4c-4a94-b401-80e5397ab8c4 tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-2d73fae6-069a-403d-b782-98abf5cc7926 req-eedd0508-9a4c-4a94-b401-80e5397ab8c4 tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-2d73fae6-069a-403d-b782-98abf5cc7926 req-eedd0508-9a4c-4a94-b401-80e5397ab8c4 tempest-ServerActionsTestOtherA-73505067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8565071a-33e7-47f4-9579-81ddc22a0f4f', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:42:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-2d73fae6-069a-403d-b782-98abf5cc7926 req-eedd0508-9a4c-4a94-b401-80e5397ab8c4 tempest-ServerActionsTestOtherA-73505067 None] attachment_update completed successfully. Jul 24 15:42:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:42:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:34 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:42:34 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:35 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.417s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:42:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:42:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 8 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:42:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:42:40 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=35,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:42:40 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-69a87f01-d08d-4d6a-8350-d68b0e5882c9 req-e4c67fa5-b061-433c-8bbd-8f0c1aa25094 tempest-TaggedAttachmentsTest-1228566648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-69a87f01-d08d-4d6a-8350-d68b0e5882c9 req-e4c67fa5-b061-433c-8bbd-8f0c1aa25094 tempest-TaggedAttachmentsTest-1228566648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-69a87f01-d08d-4d6a-8350-d68b0e5882c9 req-e4c67fa5-b061-433c-8bbd-8f0c1aa25094 tempest-TaggedAttachmentsTest-1228566648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-69a87f01-d08d-4d6a-8350-d68b0e5882c9 req-e4c67fa5-b061-433c-8bbd-8f0c1aa25094 tempest-TaggedAttachmentsTest-1228566648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5138de16-c5a5-49f4-8216-31b397109000', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:42:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-69a87f01-d08d-4d6a-8350-d68b0e5882c9 req-e4c67fa5-b061-433c-8bbd-8f0c1aa25094 tempest-TaggedAttachmentsTest-1228566648 None] attachment_update completed successfully. Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Flow 'volume_create_manager' (8b30479c-3fc2-478d-a187-b33cb1bac113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51b3b9e-e934-44f6-8eb3-7807c3097b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51b3b9e-e934-44f6-8eb3-7807c3097b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-990406631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6bf767-c3d8-4b1c-9697-5b7402cc57a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7360cbbd261c4039b184f5b639b4af92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:42:42Z,use_quota=True,user_id='f80d0da2a05e49b38ea8349b82fe3a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66b3d4ce-0e3f-4518-b36a-abf4a6211821),volume_type_id=66b3d4ce-0e3f-4518-b36a-abf4a6211821)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9d3ebf-fb90-4863-8c4f-e389958e6074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9d3ebf-fb90-4863-8c4f-e389958e6074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c524f2e2-3018-4ef6-8e03-4965e3e54223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c524f2e2-3018-4ef6-8e03-4965e3e54223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6bf767-c3d8-4b1c-9697-5b7402cc57a8', 'volume_name': 'volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570da679-fd45-4f4e-86e5-f1ef8a54c02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570da679-fd45-4f4e-86e5-f1ef8a54c02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d8be5-7140-4e68-94da-9b4e0b5845ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Volume 2f6bf767-c3d8-4b1c-9697-5b7402cc57a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8', 'volume_size': 1} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-990406631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6bf767-c3d8-4b1c-9697-5b7402cc57a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7360cbbd261c4039b184f5b639b4af92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:42:42Z,use_quota=True,user_id='f80d0da2a05e49b38ea8349b82fe3a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66b3d4ce-0e3f-4518-b36a-abf4a6211821),volume_type_id=66b3d4ce-0e3f-4518-b36a-abf4a6211821)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Creating volume 2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:42:41 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:42:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:41 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 1073741824 Jul 24 15:42:41 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:42 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 1073741824" returned: 0 in 0.634s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:42 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 Jul 24 15:42:42 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:42 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8" returned: 0 in 0.248s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d8be5-7140-4e68-94da-9b4e0b5845ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a2c029-6d3c-4362-bdc2-72be6642c1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:42 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Volume volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 (2f6bf767-c3d8-4b1c-9697-5b7402cc57a8): created successfully Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a2c029-6d3c-4362-bdc2-72be6642c1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Flow 'volume_create_manager' (8b30479c-3fc2-478d-a187-b33cb1bac113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:42:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-21efafb6-5210-48a3-a0b3-63a734b70211 tempest-VolumeTypesAccessTest-492219004 None] Created volume successfully. Jul 24 15:42:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Acquiring lock "cinder-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Lock "cinder-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Acquiring lock "cinder-quobyte-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Lock "cinder-quobyte-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:43 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9548e001-8041-4a5c-ad00-df8132920e3a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:43 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 Jul 24 15:42:43 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:44 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8" returned: 0 in 0.418s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:44 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8 Jul 24 15:42:44 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:44 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8" returned: 0 in 0.254s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Lock "cinder-quobyte-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8" released by "delete_volume" :: held 0.714s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:44 devstack cinder-volume[88251]: WARNING cinder.quota [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1419757853 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1419757853, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:42:44 devstack cinder-volume[88251]: WARNING cinder.quota [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1419757853 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1419757853, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:42:44 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-8964b524-f9b1-4211-bcfe-cd0379363d97 req-549d626c-d066-40f0-b1ad-cbbe8b177d51 tempest-TaggedAttachmentsTest-1228566648 None] Terminate volume connection completed successfully. Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-8964b524-f9b1-4211-bcfe-cd0379363d97 req-549d626c-d066-40f0-b1ad-cbbe8b177d51 tempest-TaggedAttachmentsTest-1228566648 None] Deleting attachment 5138de16-c5a5-49f4-8216-31b397109000. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Created reservations ['920ac59d-dcda-4142-bc0e-4cb5787adad3', '88a9f948-1975-4f61-98e2-fbb1a9714cd4', 'bc4f9e68-25de-4fe4-a2b4-862b235d11bb', '43c9fbac-b21d-4c1c-acb2-1b4a953b4676'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:44 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:42:44 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:45 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.434s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:45 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:42:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Deleted volume successfully. Jul 24 15:42:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d347f10-10c7-4777-a36c-4ee9c7a8a8d1 tempest-VolumeTypesAccessTest-492219004 None] Lock "cinder-2f6bf767-c3d8-4b1c-9697-5b7402cc57a8-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Acquiring lock "cinder-83368341-fb93-468d-8ab8-78545dec577a-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "cinder-83368341-fb93-468d-8ab8-78545dec577a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Acquiring lock "cinder-quobyte-83368341-fb93-468d-8ab8-78545dec577a" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "cinder-quobyte-83368341-fb93-468d-8ab8-78545dec577a" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5accd6-91a5-4917-8ed6-6de1de9824e0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:54 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a Jul 24 15:42:54 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:55 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a" returned: 0 in 0.396s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:55 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a Jul 24 15:42:55 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:55 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-83368341-fb93-468d-8ab8-78545dec577a" returned: 0 in 0.272s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "cinder-quobyte-83368341-fb93-468d-8ab8-78545dec577a" released by "delete_volume" :: held 0.728s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Created reservations ['b14d4fce-67fa-4474-94bd-5bcda063a553', 'ed69bdb2-2bb3-4865-8900-84ff6a08e106', '46fbe3de-b225-4047-bdf3-4c86c6252ab2', '55dc576e-2ae6-4208-863c-42d8619e8417'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:55 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:42:55 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:56 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.451s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:42:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Deleted volume successfully. Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d59ef45-e743-415c-878b-04472d9e7964 tempest-AttachVolumeShelveTestJSON-1682236205 None] Lock "cinder-83368341-fb93-468d-8ab8-78545dec577a-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Acquiring lock "cinder-edb81f3b-6b04-4a52-9319-5ce2f43eef85-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Lock "cinder-edb81f3b-6b04-4a52-9319-5ce2f43eef85-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Acquiring lock "cinder-quobyte-edb81f3b-6b04-4a52-9319-5ce2f43eef85" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Lock "cinder-quobyte-edb81f3b-6b04-4a52-9319-5ce2f43eef85" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f003d0-a213-4cda-8988-dafdf1ed58b0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:56 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 Jul 24 15:42:56 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:57 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85" returned: 0 in 0.488s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:57 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85 Jul 24 15:42:57 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:57 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-edb81f3b-6b04-4a52-9319-5ce2f43eef85" returned: 0 in 0.308s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Lock "cinder-quobyte-edb81f3b-6b04-4a52-9319-5ce2f43eef85" released by "delete_volume" :: held 0.868s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Created reservations ['37c6409e-bb7c-435f-b389-dce3ce450ac2', '2416049c-353f-4f32-976d-9f2d13625a50', '9a2128f2-b8da-4209-a36f-770c8e968e6e', '4bc6c50d-3337-417a-b412-f3f5592297da'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:57 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:42:57 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:58 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.366s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:58 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:42:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Deleted volume successfully. Jul 24 15:42:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9c7858a8-0fc3-41ac-9558-7a6858eb74ad tempest-TaggedAttachmentsTest-1228566648 None] Lock "cinder-edb81f3b-6b04-4a52-9319-5ce2f43eef85-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-8868535f-d0b3-4d9c-a6aa-cc8cff35b3de req-130ac898-f9ad-41b1-9232-6df80d5f35c4 tempest-ServerActionsTestOtherA-73505067 None] Terminate volume connection completed successfully. Jul 24 15:43:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-8868535f-d0b3-4d9c-a6aa-cc8cff35b3de req-130ac898-f9ad-41b1-9232-6df80d5f35c4 tempest-ServerActionsTestOtherA-73505067 None] Deleting attachment 8565071a-33e7-47f4-9579-81ddc22a0f4f. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Acquiring lock "cinder-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Lock "cinder-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Acquiring lock "cinder-quobyte-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Lock "cinder-quobyte-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[960b815e-4325-41c0-8141-3503034a12de]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:06 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e Jul 24 15:43:06 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:06 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e" returned: 0 in 0.385s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:06 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e Jul 24 15:43:06 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:06 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e" returned: 0 in 0.291s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Lock "cinder-quobyte-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e" released by "delete_volume" :: held 0.732s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Created reservations ['a3155b4d-81ce-4ce2-8cf2-8c8f7cb60b93', '7379081d-bdc4-4faa-983e-7e033013f8cb', '1e6f626b-2279-4ad1-b326-4903a3ab779f', '783923e8-85cf-4770-bd77-8fcfd9639df8'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:07 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:43:07 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:07 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.323s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:43:07 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Deleted volume successfully. Jul 24 15:43:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d83660aa-27d4-46ea-bbc2-4960be993f16 tempest-ServerActionsTestOtherA-73505067 None] Lock "cinder-5a6f170c-2b86-4bfb-879e-7bbe8b8e0a6e-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:17 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=30,cinder:UPDATE=40,cinder:INSERT=12,cinder:DELETE=5 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:43:23 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=32,cinder:UPDATE=34,cinder:INSERT=5 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:43:30 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:43:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Flow 'volume_create_manager' (2c3e9607-3728-4cf2-b1b9-95049be5f7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54557a4-e4ff-41be-b746-89386ba2d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54557a4-e4ff-41be-b746-89386ba2d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1927790598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afadb2e-075d-4b3a-bf5c-8711a1caddfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108284469569424591ac9db88b904e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:31Z,use_quota=True,user_id='bf53d7edc8b546e2bfd662f8498fc1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a6ebe6-1ea1-4269-8870-75403cdcd058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a6ebe6-1ea1-4269-8870-75403cdcd058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fd13c3-3a14-4ec9-a381-013c97d794c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:30 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:43:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fd13c3-3a14-4ec9-a381-013c97d794c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4afadb2e-075d-4b3a-bf5c-8711a1caddfa', 'volume_name': 'volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0defca3d-d6f8-483a-87df-6cfd7b13a06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0defca3d-d6f8-483a-87df-6cfd7b13a06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1e8e29-75c3-4f6a-9ff2-128072b447c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:31 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Volume 4afadb2e-075d-4b3a-bf5c-8711a1caddfa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 15:43:31 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Trying to clone 4afadb2e-075d-4b3a-bf5c-8711a1caddfa from image 2edfa101-a293-4451-bf18-908a0ec01fd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:43:31 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:43:31 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Image download 20.69 MB at 20.69 MB/s Jul 24 15:43:31 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90aad0c-e355-4186-acad-3ab55f774544]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:32 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD Jul 24 15:43:32 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:32 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:32 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Temporary image 2edfa101-a293-4451-bf18-908a0ec01fd6 is fetched for user bf53d7edc8b546e2bfd662f8498fc1ed. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:43:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4066dd12-3df3-4801-ab1a-77b2a54df396]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:32 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD Jul 24 15:43:32 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:33 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD" returned: 0 in 0.562s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1927790598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afadb2e-075d-4b3a-bf5c-8711a1caddfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108284469569424591ac9db88b904e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:31Z,use_quota=True,user_id='bf53d7edc8b546e2bfd662f8498fc1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Creating volume 4afadb2e-075d-4b3a-bf5c-8711a1caddfa {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:43:33 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:33 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa 1073741824 Jul 24 15:43:33 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:33 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa 1073741824" returned: 0 in 0.656s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:33 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa Jul 24 15:43:33 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:34 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa" returned: 0 in 0.413s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Attempting download of 2edfa101-a293-4451-bf18-908a0ec01fd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}])) to volume 4afadb2e-075d-4b3a-bf5c-8711a1caddfa. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c66e46-655e-45ef-b574-95836d27621a]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_98i7q01p {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:34 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_98i7q01p Jul 24 15:43:34 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:34 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:43:34 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:35 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.432s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:43:35 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 28 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_98i7q01p" returned: 0 in 0.781s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_98i7q01p {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:35 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_98i7q01p Jul 24 15:43:35 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:35 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_98i7q01p" returned: 1 in 0.559s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_98i7q01p' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea36f03e-1163-43a5-b83c-4f7a1930f5a1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:36 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD Jul 24 15:43:36 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:36 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD" returned: 0 in 0.519s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:36 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] 2edfa101-a293-4451-bf18-908a0ec01fd6 was qcow2, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:43:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:36 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa Jul 24 15:43:36 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:39 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa" returned: 0 in 3.241s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:39 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_5cfg5vz9devstack@QuobyteHD, size 112.00 MB, duration 3.24 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:43:39 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Converted 112.00 MB image at 34.53 MB/s Jul 24 15:43:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:39 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa 1G Jul 24 15:43:39 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:40 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa 1G" returned: 0 in 0.700s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Downloaded image 2edfa101-a293-4451-bf18-908a0ec01fd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}])) to volume 4afadb2e-075d-4b3a-bf5c-8711a1caddfa successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Temporary image 2edfa101-a293-4451-bf18-908a0ec01fd6 for user bf53d7edc8b546e2bfd662f8498fc1ed is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Marking volume 4afadb2e-075d-4b3a-bf5c-8711a1caddfa as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Copying metadata from image 2edfa101-a293-4451-bf18-908a0ec01fd6 to 4afadb2e-075d-4b3a-bf5c-8711a1caddfa. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Creating volume glance metadata for volume 4afadb2e-075d-4b3a-bf5c-8711a1caddfa backed by image 2edfa101-a293-4451-bf18-908a0ec01fd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1e8e29-75c3-4f6a-9ff2-128072b447c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49445bc9-268c-4e81-b1e5-06f2870dda44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:40 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Volume volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa (4afadb2e-075d-4b3a-bf5c-8711a1caddfa): created successfully Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49445bc9-268c-4e81-b1e5-06f2870dda44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Flow 'volume_create_manager' (2c3e9607-3728-4cf2-b1b9-95049be5f7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:40 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-41de35df-e0d6-4554-871f-0c33b3cc976c tempest-VolumesImageMetadata-1960941691 None] Created volume successfully. Jul 24 15:43:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Acquiring lock "cinder-4afadb2e-075d-4b3a-bf5c-8711a1caddfa-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Lock "cinder-4afadb2e-075d-4b3a-bf5c-8711a1caddfa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Acquiring lock "cinder-quobyte-4afadb2e-075d-4b3a-bf5c-8711a1caddfa" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Lock "cinder-quobyte-4afadb2e-075d-4b3a-bf5c-8711a1caddfa" acquired by "delete_volume" :: waited 0.042s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f1480d-b490-4431-90af-fb79117bd4a1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:41 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa Jul 24 15:43:41 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:42 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa" returned: 0 in 0.547s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:42 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa Jul 24 15:43:42 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:42 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4afadb2e-075d-4b3a-bf5c-8711a1caddfa" returned: 0 in 0.492s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Lock "cinder-quobyte-4afadb2e-075d-4b3a-bf5c-8711a1caddfa" released by "delete_volume" :: held 1.103s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Created reservations ['69d8a889-91f0-4ea1-b6dd-55367ad359ec', '600760d3-ba3a-4181-a6f9-33bce08b12ff', 'f2906635-7195-471b-ac9a-5327e0f797e8', '4e829fcd-6673-4cf9-bddc-ac0044d10999'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:42 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:43:42 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:43 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.613s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:43 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:43:43 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Deleted volume successfully. Jul 24 15:43:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4033cf0d-328c-4e68-ad6c-494dd20cd910 tempest-VolumesImageMetadata-1960941691 None] Lock "cinder-4afadb2e-075d-4b3a-bf5c-8711a1caddfa-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Flow 'volume_create_manager' (b5422ae8-021b-490c-a474-5e8db34fd919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8f84b6-cc17-4eb2-aaf6-2affef25a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8f84b6-cc17-4eb2-aaf6-2affef25a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1761823334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830a21c7-0dc4-4f22-a330-4ab720619a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b1d60e08c149259b6c8f31992a3ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:50Z,use_quota=True,user_id='962647ee3be744528a52c22f502df814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc1fc12-0d54-4ef6-a9e6-640f640c74e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc1fc12-0d54-4ef6-a9e6-640f640c74e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b76a2c5-2d97-4f0f-931b-7445216e3b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b76a2c5-2d97-4f0f-931b-7445216e3b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830a21c7-0dc4-4f22-a330-4ab720619a29', 'volume_name': 'volume-830a21c7-0dc4-4f22-a330-4ab720619a29', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e11331-205a-4da8-a916-6166a7c786f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e11331-205a-4da8-a916-6166a7c786f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f7df92-3ce0-453e-9e16-517c754a9b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Volume 830a21c7-0dc4-4f22-a330-4ab720619a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830a21c7-0dc4-4f22-a330-4ab720619a29', 'volume_size': 1} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1761823334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830a21c7-0dc4-4f22-a330-4ab720619a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b1d60e08c149259b6c8f31992a3ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:50Z,use_quota=True,user_id='962647ee3be744528a52c22f502df814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Creating volume 830a21c7-0dc4-4f22-a330-4ab720619a29 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:43:50 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:50 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 1073741824 Jul 24 15:43:50 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:50 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 1073741824" returned: 0 in 0.571s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:51 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 Jul 24 15:43:51 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:51 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29" returned: 0 in 0.470s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f7df92-3ce0-453e-9e16-517c754a9b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830a21c7-0dc4-4f22-a330-4ab720619a29', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5e3d40-beb3-4ef3-8ece-3c97cc7e67c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Volume volume-830a21c7-0dc4-4f22-a330-4ab720619a29 (830a21c7-0dc4-4f22-a330-4ab720619a29): created successfully Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5e3d40-beb3-4ef3-8ece-3c97cc7e67c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Flow 'volume_create_manager' (b5422ae8-021b-490c-a474-5e8db34fd919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8cb536ce-06f2-4d09-ad52-1c291dc7e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Created volume successfully. Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Flow 'volume_create_manager' (5c6670f2-92f4-4cd4-b0c7-beed8b7c6e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf64cc67-ee00-4dc0-bd77-65153957e1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf64cc67-ee00-4dc0-bd77-65153957e1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1420136671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1b7598-14b3-452a-9f5b-83974c8f5436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe8006501bc46f8a81a91b27e1d1a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:52Z,use_quota=True,user_id='c899c654447a4008b83c87a2a4464621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8887adb0-d672-476d-8b75-1e6a7a477f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8887adb0-d672-476d-8b75-1e6a7a477f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6194a7-7feb-40bc-829f-53238c3245ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6194a7-7feb-40bc-829f-53238c3245ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1b7598-14b3-452a-9f5b-83974c8f5436', 'volume_name': 'volume-ea1b7598-14b3-452a-9f5b-83974c8f5436', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aa8ef0-554e-4c85-861c-3b4f6d3f0553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aa8ef0-554e-4c85-861c-3b4f6d3f0553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2deab9-7c7d-41aa-883e-9bbb68683c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:52 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Volume ea1b7598-14b3-452a-9f5b-83974c8f5436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1b7598-14b3-452a-9f5b-83974c8f5436', 'volume_size': 1} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1420136671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1b7598-14b3-452a-9f5b-83974c8f5436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe8006501bc46f8a81a91b27e1d1a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:52Z,use_quota=True,user_id='c899c654447a4008b83c87a2a4464621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Creating volume ea1b7598-14b3-452a-9f5b-83974c8f5436 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:43:52 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:52 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 1073741824 Jul 24 15:43:52 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:52 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 1073741824" returned: 0 in 0.766s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:52 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 Jul 24 15:43:52 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:53 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436" returned: 0 in 0.352s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.379s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2deab9-7c7d-41aa-883e-9bbb68683c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1b7598-14b3-452a-9f5b-83974c8f5436', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f6195c-bfc4-4168-bae0-7a5dffc4ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Creating offline snapshot 2bc36925-3101-437f-938b-feecb036c1ce of volume 830a21c7-0dc4-4f22-a330-4ab720619a29 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:43:53 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Volume volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 (ea1b7598-14b3-452a-9f5b-83974c8f5436): created successfully Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f6195c-bfc4-4168-bae0-7a5dffc4ac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Flow 'volume_create_manager' (5c6670f2-92f4-4cd4-b0c7-beed8b7c6e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e452c-6de1-43a4-9366-469b157427e2]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c73b07a6-4de3-4c7d-aab1-80c55531d8d0 tempest-AbsoluteLimitsTests-1723641703 None] Created volume successfully. Jul 24 15:43:53 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 Jul 24 15:43:53 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:53 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29" returned: 0 in 0.433s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:53 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce 1G Jul 24 15:43:53 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Acquiring lock "cinder-ea1b7598-14b3-452a-9f5b-83974c8f5436-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Lock "cinder-ea1b7598-14b3-452a-9f5b-83974c8f5436-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Acquiring lock "cinder-quobyte-ea1b7598-14b3-452a-9f5b-83974c8f5436" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Lock "cinder-quobyte-ea1b7598-14b3-452a-9f5b-83974c8f5436" acquired by "delete_volume" :: waited 0.032s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e2341d-9e5e-4396-9cfb-bd3fcf4e0830]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:54 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce 1G" returned: 0 in 0.751s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830a21c7-0dc4-4f22-a330-4ab720619a29 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:54 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830a21c7-0dc4-4f22-a330-4ab720619a29 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce Jul 24 15:43:54 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:54 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 Jul 24 15:43:54 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:55 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:55 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830a21c7-0dc4-4f22-a330-4ab720619a29 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce" returned: 0 in 0.615s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:55 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce is being set with open permissions: ugo+rw Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436" returned: 0 in 0.721s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:55 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce Jul 24 15:43:55 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:55 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436 Jul 24 15:43:55 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:55 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce" returned: 0 in 0.576s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:55 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ea1b7598-14b3-452a-9f5b-83974c8f5436" returned: 0 in 0.646s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Lock "cinder-quobyte-ea1b7598-14b3-452a-9f5b-83974c8f5436" released by "delete_volume" :: held 1.459s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:55 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.info Jul 24 15:43:55 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:55 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Created reservations ['d23a7257-5559-4261-a405-319482816c12', 'a7a44d82-4d82-4322-9a33-e6c6a879ace3', '973f2566-4b79-49e1-b97f-12cc4f01c377', 'e1332fc7-9a0f-47af-8079-2ca930514af6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:56 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:43:56 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:56 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.info" returned: 0 in 0.572s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:56 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.info is being set with open permissions: ugo+rw Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:56 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.info Jul 24 15:43:56 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:56 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.714s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:43:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Deleted volume successfully. Jul 24 15:43:56 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a4f9cffc-35bf-4802-b227-e8470f1431db tempest-AbsoluteLimitsTests-1723641703 None] Lock "cinder-ea1b7598-14b3-452a-9f5b-83974c8f5436-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.info" returned: 0 in 0.535s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.773s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:57 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-11e1dac9-cf39-47b3-aa45-58214e67e5d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Create snapshot completed successfully Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "cinder-2bc36925-3101-437f-938b-feecb036c1ce-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-2bc36925-3101-437f-938b-feecb036c1ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "cinder-quobyte-830a21c7-0dc4-4f22-a330-4ab720619a29" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-quobyte-830a21c7-0dc4-4f22-a330-4ab720619a29" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "cinder-quobyte-2bc36925-3101-437f-938b-feecb036c1ce" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-quobyte-2bc36925-3101-437f-938b-feecb036c1ce" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Deleting offline snapshot 2bc36925-3101-437f-938b-feecb036c1ce of volume 830a21c7-0dc4-4f22-a330-4ab720619a29 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] snapshot_file for this snap is: volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17bddd7-15ab-40e9-913c-7304d0860a60]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:43:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:59 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce Jul 24 15:43:59 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:00 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce" returned: 0 in 0.613s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830a21c7-0dc4-4f22-a330-4ab720619a29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:44:00 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a7bbbc-8f3e-4ee2-97e3-26f26388f4d1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:00 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 Jul 24 15:44:00 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:00 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29" returned: 0 in 0.859s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:01 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce Jul 24 15:44:01 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:01 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce" returned: 0 in 0.690s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:01 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce Jul 24 15:44:01 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:02 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29.2bc36925-3101-437f-938b-feecb036c1ce" returned: 0 in 0.423s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Flow 'volume_create_manager' (5c50287e-cd16-44f3-bdf6-a45f51ca8d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788f923f-d36f-45e2-8a05-42d006de9f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-quobyte-2bc36925-3101-437f-938b-feecb036c1ce" released by "_delete_snapshot" :: held 2.828s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788f923f-d36f-45e2-8a05-42d006de9f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1300851033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32afe506-3082-4840-8377-5031e6ec532d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d901a276bc4fcca778dd4319508f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:02Z,use_quota=True,user_id='2e808014a46e4c989bed96dab5b7a934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87956182-3901-4682-bfb8-21ce3db6af2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87956182-3901-4682-bfb8-21ce3db6af2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db204260-8819-46b5-bade-150cb37d2f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db204260-8819-46b5-bade-150cb37d2f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32afe506-3082-4840-8377-5031e6ec532d', 'volume_name': 'volume-32afe506-3082-4840-8377-5031e6ec532d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc63baf2-f253-4fcd-bc2d-1681e840bf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc63baf2-f253-4fcd-bc2d-1681e840bf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861097a4-993b-4a55-9950-7d65096e01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:02 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Volume 32afe506-3082-4840-8377-5031e6ec532d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32afe506-3082-4840-8377-5031e6ec532d', 'volume_size': 1} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1300851033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32afe506-3082-4840-8377-5031e6ec532d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d901a276bc4fcca778dd4319508f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:02Z,use_quota=True,user_id='2e808014a46e4c989bed96dab5b7a934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Creating volume 32afe506-3082-4840-8377-5031e6ec532d {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:02 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-quobyte-830a21c7-0dc4-4f22-a330-4ab720619a29" released by "delete_snapshot" :: held 2.981s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:02 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d 1073741824 Jul 24 15:44:02 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Created reservations ['626ba9ff-c419-420c-87e2-4e1270e6a835', 'e7048252-b96e-438e-933c-c4cb91be38ca', '6974f0f9-2933-45d8-a571-3c4728d8098a', 'a06ecc12-0bb7-4d87-b0d2-48fd1b141ca0'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:02 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Delete snapshot completed successfully. Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b139d207-b561-48a9-9fc9-d633477a0315 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-2bc36925-3101-437f-938b-feecb036c1ce-delete_snapshot" released by "delete_snapshot" :: held 3.220s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "cinder-830a21c7-0dc4-4f22-a330-4ab720619a29-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-830a21c7-0dc4-4f22-a330-4ab720619a29-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "cinder-quobyte-830a21c7-0dc4-4f22-a330-4ab720619a29" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-quobyte-830a21c7-0dc4-4f22-a330-4ab720619a29" acquired by "delete_volume" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5524af5a-e449-4a34-b957-f250a990e7e7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:03 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d 1073741824" returned: 0 in 0.735s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:03 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 Jul 24 15:44:03 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:03 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d Jul 24 15:44:03 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:03 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29" returned: 0 in 0.577s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:03 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d" returned: 0 in 0.428s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:03 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29 Jul 24 15:44:03 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861097a4-993b-4a55-9950-7d65096e01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32afe506-3082-4840-8377-5031e6ec532d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faf3c98-8ac2-4aeb-8ae2-ddf3b1dcbe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:03 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Volume volume-32afe506-3082-4840-8377-5031e6ec532d (32afe506-3082-4840-8377-5031e6ec532d): created successfully Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faf3c98-8ac2-4aeb-8ae2-ddf3b1dcbe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Flow 'volume_create_manager' (5c50287e-cd16-44f3-bdf6-a45f51ca8d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:03 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f7dd2086-2224-4730-a5b0-e3931d254c9b tempest-AttachVolumeTestJSON-197735795 None] Created volume successfully. Jul 24 15:44:03 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-830a21c7-0dc4-4f22-a330-4ab720619a29" returned: 0 in 0.349s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-quobyte-830a21c7-0dc4-4f22-a330-4ab720619a29" released by "delete_volume" :: held 1.028s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Created reservations ['24cf5d21-b7d1-4423-a9fb-87ef3ad80e59', '66306588-6b0d-4c51-9443-5a93d5316cd9', '868cd727-c7c3-41cf-b52c-327d69e4bdbd', '76c119b9-12b2-455b-be25-0a4a85036eb0'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:04 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:04 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:04 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Flow 'volume_create_manager' (e87b2af7-52b9-4b02-a4b5-04541b2ce4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1edb994-4f20-478c-bafa-1aacbca8e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.401s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1edb994-4f20-478c-bafa-1aacbca8e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1606800078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa74ae4-65bb-474d-80b5-025f4f5b1313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b2d2488a8f4882878448e8dd536588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:04Z,use_quota=True,user_id='7152f28459364f818b6dad721c829116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0f423d-785a-4531-982e-bc899026887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0f423d-785a-4531-982e-bc899026887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839a5d62-1ec0-42ee-8638-4cf9446070e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839a5d62-1ec0-42ee-8638-4cf9446070e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa74ae4-65bb-474d-80b5-025f4f5b1313', 'volume_name': 'volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313', 'volume_size': 2}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3274d222-4dc5-485c-b762-7686cc06c10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3274d222-4dc5-485c-b762-7686cc06c10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a329636d-d79c-4610-b3a1-12fe0b06ab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:04 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Volume 2fa74ae4-65bb-474d-80b5-025f4f5b1313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313', 'volume_size': 2} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1606800078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa74ae4-65bb-474d-80b5-025f4f5b1313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b2d2488a8f4882878448e8dd536588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:04Z,use_quota=True,user_id='7152f28459364f818b6dad721c829116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Creating volume 2fa74ae4-65bb-474d-80b5-025f4f5b1313 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:04 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 2147483648 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:04 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Deleted volume successfully. Jul 24 15:44:04 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 2147483648 Jul 24 15:44:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adb21d74-a37d-4364-8016-e4b3c4cf2782 tempest-VolumeSnapshotQuotasNegativeTestJSON-1535462561 None] Lock "cinder-830a21c7-0dc4-4f22-a330-4ab720619a29-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:04 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-40bc1943-2d90-4e28-8c52-4b0bdb103fbf req-264f7406-8d0a-4926-9bb4-8f6016b0d256 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Flow 'volume_create_manager' (f2dd60e2-3df2-4bdf-9753-4b13cabb43df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736b1551-909c-4f56-b140-ee47106f3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736b1551-909c-4f56-b140-ee47106f3406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1645993638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04eb6c42-ec93-49e5-90b3-f70d1337ddcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11773c06b30a4332be79a5bcc278a537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:05Z,use_quota=True,user_id='bf2dcddb57914acd973843a0f69c3720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1137058c-677b-44f4-ad5b-8a1515461369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1137058c-677b-44f4-ad5b-8a1515461369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e947c2-8388-437e-bc64-b97faf563bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e947c2-8388-437e-bc64-b97faf563bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04eb6c42-ec93-49e5-90b3-f70d1337ddcd', 'volume_name': 'volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a275a3f-2266-41b6-890f-5fe0ab2f3529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a275a3f-2266-41b6-890f-5fe0ab2f3529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1d5385-2781-4856-b0aa-b354e1499ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Volume 04eb6c42-ec93-49e5-90b3-f70d1337ddcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd', 'volume_size': 1} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:05 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 2147483648" returned: 0 in 0.660s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:05 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 Jul 24 15:44:05 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:05 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313" returned: 0 in 0.274s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-40bc1943-2d90-4e28-8c52-4b0bdb103fbf req-264f7406-8d0a-4926-9bb4-8f6016b0d256 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.545s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a329636d-d79c-4610-b3a1-12fe0b06ab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313', 'volume_size': 2}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2c0849-bb0a-4bc7-9555-c5352315a9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-40bc1943-2d90-4e28-8c52-4b0bdb103fbf req-264f7406-8d0a-4926-9bb4-8f6016b0d256 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1645993638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04eb6c42-ec93-49e5-90b3-f70d1337ddcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11773c06b30a4332be79a5bcc278a537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:05Z,use_quota=True,user_id='bf2dcddb57914acd973843a0f69c3720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Creating volume 04eb6c42-ec93-49e5-90b3-f70d1337ddcd {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:05 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Volume volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 (2fa74ae4-65bb-474d-80b5-025f4f5b1313): created successfully Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2c0849-bb0a-4bc7-9555-c5352315a9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Flow 'volume_create_manager' (e87b2af7-52b9-4b02-a4b5-04541b2ce4e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:05 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd 1073741824 Jul 24 15:44:05 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9f9461e4-593c-4be2-a7af-4871aff80a27 tempest-VolumesCloneNegativeTest-987207237 None] Created volume successfully. Jul 24 15:44:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-40bc1943-2d90-4e28-8c52-4b0bdb103fbf req-264f7406-8d0a-4926-9bb4-8f6016b0d256 tempest-AttachVolumeTestJSON-197735795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-32afe506-3082-4840-8377-5031e6ec532d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51911b05-f085-480d-9b3a-00f161b17a63', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:44:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-40bc1943-2d90-4e28-8c52-4b0bdb103fbf req-264f7406-8d0a-4926-9bb4-8f6016b0d256 tempest-AttachVolumeTestJSON-197735795 None] attachment_update completed successfully. Jul 24 15:44:06 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd 1073741824" returned: 0 in 0.516s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:06 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd Jul 24 15:44:06 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:06 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd" returned: 0 in 0.313s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1d5385-2781-4856-b0aa-b354e1499ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f22186f-e073-4408-862b-2f5ae02b6cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:06 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Volume volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd (04eb6c42-ec93-49e5-90b3-f70d1337ddcd): created successfully Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f22186f-e073-4408-862b-2f5ae02b6cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Flow 'volume_create_manager' (f2dd60e2-3df2-4bdf-9753-4b13cabb43df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-dbc60ea2-d7cb-48c2-858d-6a74bdaa8ce5 tempest-ServersNegativeTestJSON-87680040 None] Created volume successfully. Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Acquiring lock "cinder-2fa74ae4-65bb-474d-80b5-025f4f5b1313-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Lock "cinder-2fa74ae4-65bb-474d-80b5-025f4f5b1313-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Acquiring lock "cinder-quobyte-2fa74ae4-65bb-474d-80b5-025f4f5b1313" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Lock "cinder-quobyte-2fa74ae4-65bb-474d-80b5-025f4f5b1313" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc51153-a991-4e38-b405-04d67d9f7aca]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:07 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 Jul 24 15:44:07 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:07 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313" returned: 0 in 0.606s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:07 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313 Jul 24 15:44:07 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:07 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2fa74ae4-65bb-474d-80b5-025f4f5b1313" returned: 0 in 0.314s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Lock "cinder-quobyte-2fa74ae4-65bb-474d-80b5-025f4f5b1313" released by "delete_volume" :: held 1.020s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Created reservations ['e7f7a958-3914-40bd-83e7-6fc8eb050062', 'f37f52a0-7c6f-4081-bb41-93628140da4d', 'bef7f4a1-47a9-4c37-b34d-c1475453cec4', 'f4fbb5a3-9243-4e9d-869a-9845be2416fc'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:08 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:08 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:08 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.396s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:08 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Deleted volume successfully. Jul 24 15:44:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-070d497c-a831-45ba-bb38-cd9e906e7d22 tempest-VolumesCloneNegativeTest-987207237 None] Lock "cinder-2fa74ae4-65bb-474d-80b5-025f4f5b1313-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Flow 'volume_create_manager' (dec795ee-66e8-4990-879e-6a617b3bc962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86c4ae8-56bc-4c81-b517-44f65ac52f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86c4ae8-56bc-4c81-b517-44f65ac52f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-386827953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce2ee60-a7d8-4454-8866-2ca51a3ba356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11773c06b30a4332be79a5bcc278a537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:09Z,use_quota=True,user_id='bf2dcddb57914acd973843a0f69c3720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713ff8df-3917-4c19-a8b1-797e2f2ab517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713ff8df-3917-4c19-a8b1-797e2f2ab517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dab575d-e821-4be8-a5a6-477ae2b19312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dab575d-e821-4be8-a5a6-477ae2b19312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce2ee60-a7d8-4454-8866-2ca51a3ba356', 'volume_name': 'volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb9f7c8-3804-43eb-b9dd-dbf3b86a51db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb9f7c8-3804-43eb-b9dd-dbf3b86a51db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b126f34-f97f-4524-a839-e2fea282fe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:09 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Volume 7ce2ee60-a7d8-4454-8866-2ca51a3ba356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356', 'volume_size': 1} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-386827953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce2ee60-a7d8-4454-8866-2ca51a3ba356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11773c06b30a4332be79a5bcc278a537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:09Z,use_quota=True,user_id='bf2dcddb57914acd973843a0f69c3720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Creating volume 7ce2ee60-a7d8-4454-8866-2ca51a3ba356 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:09 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:09 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 1073741824 Jul 24 15:44:09 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:10 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 1073741824" returned: 0 in 0.662s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:10 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 Jul 24 15:44:10 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:10 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356" returned: 0 in 0.485s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b126f34-f97f-4524-a839-e2fea282fe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ad7943-c945-42a6-a5e8-72a3925de310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:10 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Volume volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 (7ce2ee60-a7d8-4454-8866-2ca51a3ba356): created successfully Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ad7943-c945-42a6-a5e8-72a3925de310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Flow 'volume_create_manager' (dec795ee-66e8-4990-879e-6a617b3bc962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:10 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-324704df-95ae-41a8-ac67-b4dea98e64d6 tempest-ServersNegativeTestJSON-87680040 None] Created volume successfully. Jul 24 15:44:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "cinder-7ce2ee60-a7d8-4454-8866-2ca51a3ba356-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Lock "cinder-7ce2ee60-a7d8-4454-8866-2ca51a3ba356-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "cinder-quobyte-7ce2ee60-a7d8-4454-8866-2ca51a3ba356" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Lock "cinder-quobyte-7ce2ee60-a7d8-4454-8866-2ca51a3ba356" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:12 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[416b23e9-cd60-4e42-85e8-c24fe3fd847e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:12 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 Jul 24 15:44:12 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:13 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356" returned: 0 in 0.832s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:13 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356 Jul 24 15:44:13 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:13 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7ce2ee60-a7d8-4454-8866-2ca51a3ba356" returned: 0 in 0.506s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Lock "cinder-quobyte-7ce2ee60-a7d8-4454-8866-2ca51a3ba356" released by "delete_volume" :: held 1.447s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Created reservations ['85f807b6-144b-4254-94e1-799defc157e3', 'c6bec227-e7c2-4c62-8254-d838b318a38a', '61aa469f-ff11-4e78-97d0-05687592dd77', 'df8aca8e-ec10-451f-8696-fe86dbae6b47'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:13 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:13 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:14 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.363s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Deleted volume successfully. Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e9f0bad-fc7a-412e-9cc0-1d537b776563 tempest-ServersNegativeTestJSON-87680040 None] Lock "cinder-7ce2ee60-a7d8-4454-8866-2ca51a3ba356-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "cinder-04eb6c42-ec93-49e5-90b3-f70d1337ddcd-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Lock "cinder-04eb6c42-ec93-49e5-90b3-f70d1337ddcd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "cinder-quobyte-04eb6c42-ec93-49e5-90b3-f70d1337ddcd" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Lock "cinder-quobyte-04eb6c42-ec93-49e5-90b3-f70d1337ddcd" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbcdd6d-84ed-4771-8c0b-313f2af1f777]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:14 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd Jul 24 15:44:14 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:15 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd" returned: 0 in 0.559s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:15 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd Jul 24 15:44:15 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:15 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04eb6c42-ec93-49e5-90b3-f70d1337ddcd" returned: 0 in 0.466s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Lock "cinder-quobyte-04eb6c42-ec93-49e5-90b3-f70d1337ddcd" released by "delete_volume" :: held 1.104s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:15 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Created reservations ['67f178f9-b11c-452a-bd50-5cf88dfe2dde', 'af14fc42-b2ed-4e9d-93e2-861e890c62f3', '96be2b25-72d0-4cd6-b8fb-207263df3ace', '752a7228-03ec-4e9f-8656-e611df63cd59'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:16 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:16 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:16 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.383s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Deleted volume successfully. Jul 24 15:44:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d097ed06-5b76-45e7-b001-cdbb9cb7ced0 tempest-ServersNegativeTestJSON-87680040 None] Lock "cinder-04eb6c42-ec93-49e5-90b3-f70d1337ddcd-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:17 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Flow 'volume_create_manager' (555da27e-fe87-46e0-978e-44e4d99943be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fdc137-0798-4fde-98e6-508875dee33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fdc137-0798-4fde-98e6-508875dee33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1357437294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54487271-6a06-4c49-829c-3e454598537d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cbe6b4bb98421a9a61776b72781eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:17Z,use_quota=True,user_id='b6cdc03dfda04d8ebad280e7deb903e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abc0924-7862-4edd-adb9-d78b5dbc9f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abc0924-7862-4edd-adb9-d78b5dbc9f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36c12f4-c304-4a4b-a25a-5932d8a56db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:17 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:44:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36c12f4-c304-4a4b-a25a-5932d8a56db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54487271-6a06-4c49-829c-3e454598537d', 'volume_name': 'volume-54487271-6a06-4c49-829c-3e454598537d', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee9e5dc-7875-4645-bd0a-4dbf4d4e66bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee9e5dc-7875-4645-bd0a-4dbf4d4e66bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb4f58-93a3-438c-9166-0604cf48843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:18 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Volume 54487271-6a06-4c49-829c-3e454598537d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54487271-6a06-4c49-829c-3e454598537d', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 15:44:18 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Trying to clone 54487271-6a06-4c49-829c-3e454598537d from image 2edfa101-a293-4451-bf18-908a0ec01fd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:44:19 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:44:19 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Image download 20.69 MB at 20.69 MB/s Jul 24 15:44:19 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95e51e-bbec-4d0e-89cc-5d0652426afb]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:19 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD Jul 24 15:44:19 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:19 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD" returned: 0 in 0.601s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:19 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Temporary image 2edfa101-a293-4451-bf18-908a0ec01fd6 is fetched for user b6cdc03dfda04d8ebad280e7deb903e9. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:44:19 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56f88b8-cf8f-4dc6-ace4-d9e4e4a90eac]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:20 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD Jul 24 15:44:20 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:20 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1357437294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54487271-6a06-4c49-829c-3e454598537d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cbe6b4bb98421a9a61776b72781eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:17Z,use_quota=True,user_id='b6cdc03dfda04d8ebad280e7deb903e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Creating volume 54487271-6a06-4c49-829c-3e454598537d {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:20 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:20 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d 1073741824 Jul 24 15:44:20 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:20 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d 1073741824" returned: 0 in 0.431s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:20 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d Jul 24 15:44:20 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:21 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d" returned: 0 in 0.371s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Attempting download of 2edfa101-a293-4451-bf18-908a0ec01fd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}])) to volume 54487271-6a06-4c49-829c-3e454598537d. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ea49fb-59cc-4fe9-a832-fe751afd26f8]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_nvoqwozt {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:21 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_nvoqwozt Jul 24 15:44:21 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Flow 'volume_create_manager' (fd5f9681-8367-4af9-b517-8b1d520a5da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb1e21e-ff1d-44b2-b15a-e9ad3c175489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:21 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb1e21e-ff1d-44b2-b15a-e9ad3c175489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-535073419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70bf4ee-61c7-4697-bf57-d9dc995337b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea96e54b22f648919bf63fc09984ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:22Z,use_quota=True,user_id='6d1b28f96bf04eec855fc3e5aa507629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16791ad6-7dbb-41ef-8738-ad125f10b278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16791ad6-7dbb-41ef-8738-ad125f10b278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f2a625-4fd6-4092-b84d-3ec6eb5bf74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f2a625-4fd6-4092-b84d-3ec6eb5bf74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70bf4ee-61c7-4697-bf57-d9dc995337b1', 'volume_name': 'volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7224ef18-da68-4fe1-9477-7e12f747aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7224ef18-da68-4fe1-9477-7e12f747aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5b7990-9c07-49a2-a204-95e1e14ca88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Volume f70bf4ee-61c7-4697-bf57-d9dc995337b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1', 'volume_size': 1} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-535073419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70bf4ee-61c7-4697-bf57-d9dc995337b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea96e54b22f648919bf63fc09984ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:22Z,use_quota=True,user_id='6d1b28f96bf04eec855fc3e5aa507629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Creating volume f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:21 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_nvoqwozt" returned: 0 in 0.620s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_nvoqwozt {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:21 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 1073741824 Jul 24 15:44:21 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:22 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_nvoqwozt Jul 24 15:44:22 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:22 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_nvoqwozt" returned: 1 in 0.343s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_nvoqwozt' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b400c0c-ce7e-4930-8f49-0d5033aaa0ac]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:22 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD Jul 24 15:44:22 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:22 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 1073741824" returned: 0 in 0.514s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:22 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 Jul 24 15:44:22 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:22 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] 2edfa101-a293-4451-bf18-908a0ec01fd6 was qcow2, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:22 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d Jul 24 15:44:22 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:22 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1" returned: 0 in 0.420s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5b7990-9c07-49a2-a204-95e1e14ca88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ccb9a5-a06f-4821-9242-d5929716a8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:22 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Volume volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 (f70bf4ee-61c7-4697-bf57-d9dc995337b1): created successfully Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ccb9a5-a06f-4821-9242-d5929716a8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Flow 'volume_create_manager' (fd5f9681-8367-4af9-b517-8b1d520a5da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e2eaed96-939a-4067-a8ef-af66217fa067 tempest-VolumesDeleteCascade-1907189343 None] Created volume successfully. Jul 24 15:44:24 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=91,cinder:SELECT=71,cinder:INSERT=14,cinder:DELETE=8 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Creating offline snapshot fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 of volume f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:44:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb26ba-babd-4572-8102-bc859330bcd3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:24 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 Jul 24 15:44:24 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:24 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1" returned: 0 in 0.523s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:24 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 1G Jul 24 15:44:24 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:25 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d" returned: 0 in 2.340s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_9u0hk7pxdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:44:25 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Converted 112.00 MB image at 47.76 MB/s Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:25 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d 1G Jul 24 15:44:25 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:25 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 1G" returned: 0 in 0.533s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:25 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 Jul 24 15:44:25 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:25 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d 1G" returned: 0 in 0.489s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Downloaded image 2edfa101-a293-4451-bf18-908a0ec01fd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}])) to volume 54487271-6a06-4c49-829c-3e454598537d successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Temporary image 2edfa101-a293-4451-bf18-908a0ec01fd6 for user b6cdc03dfda04d8ebad280e7deb903e9 is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Marking volume 54487271-6a06-4c49-829c-3e454598537d as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Copying metadata from image 2edfa101-a293-4451-bf18-908a0ec01fd6 to 54487271-6a06-4c49-829c-3e454598537d. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Creating volume glance metadata for volume 54487271-6a06-4c49-829c-3e454598537d backed by image 2edfa101-a293-4451-bf18-908a0ec01fd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb4f58-93a3-438c-9166-0604cf48843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54487271-6a06-4c49-829c-3e454598537d', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28fe7dc-1283-4e30-a994-2a23e3eaad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Volume volume-54487271-6a06-4c49-829c-3e454598537d (54487271-6a06-4c49-829c-3e454598537d): created successfully Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28fe7dc-1283-4e30-a994-2a23e3eaad7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Flow 'volume_create_manager' (555da27e-fe87-46e0-978e-44e4d99943be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-20ae4192-daa1-4bc9-b60f-ce11ddc38ae7 tempest-VolumesExtendTest-338207526 None] Created volume successfully. Jul 24 15:44:25 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" returned: 0 in 0.463s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:25 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 is being set with open permissions: ugo+rw Jul 24 15:44:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:25 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 Jul 24 15:44:25 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:26 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" returned: 0 in 0.298s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:26 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.info Jul 24 15:44:26 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-376359f9-f8c0-4555-bc97-c12bcca07b3f tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:26 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.info" returned: 0 in 0.381s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:26 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.info is being set with open permissions: ugo+rw Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:26 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.info Jul 24 15:44:26 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:26 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.info" returned: 0 in 0.293s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-376359f9-f8c0-4555-bc97-c12bcca07b3f tempest-VolumesExtendTest-338207526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.427s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[61774817-9fd6-40af-83d1-cb9b8bd65c44]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376359f9-f8c0-4555-bc97-c12bcca07b3f tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fd15f57a-a30d-433f-a215-63ebe5fc9600 tempest-VolumesDeleteCascade-1907189343 None] Create snapshot completed successfully Jul 24 15:44:27 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d Jul 24 15:44:27 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:27 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376359f9-f8c0-4555-bc97-c12bcca07b3f tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d" returned: 0 in 0.406s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376359f9-f8c0-4555-bc97-c12bcca07b3f tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d 2G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376359f9-f8c0-4555-bc97-c12bcca07b3f tempest-VolumesExtendTest-338207526 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d 2G" returned: 0 in 0.108s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-376359f9-f8c0-4555-bc97-c12bcca07b3f tempest-VolumesExtendTest-338207526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.544s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=86,cinder:INSERT=44,cinder:UPDATE=85,cinder:DELETE=9 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-376359f9-f8c0-4555-bc97-c12bcca07b3f tempest-VolumesExtendTest-338207526 None] Extend volume completed successfully. Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Creating offline snapshot a0711a23-cac8-4f5f-a792-18f6e1435f5d of volume f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7997d997-8b28-4e36-9fe4-2615aa2ea813]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:27 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 Jul 24 15:44:27 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:28 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" returned: 0 in 0.393s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:44:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:28 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d 1G Jul 24 15:44:28 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:28 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d 1G" returned: 0 in 0.619s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:28 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d Jul 24 15:44:28 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Acquiring lock "cinder-54487271-6a06-4c49-829c-3e454598537d-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Lock "cinder-54487271-6a06-4c49-829c-3e454598537d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Acquiring lock "cinder-quobyte-54487271-6a06-4c49-829c-3e454598537d" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Lock "cinder-quobyte-54487271-6a06-4c49-829c-3e454598537d" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[421af869-7a48-4ffa-8f76-98954f4179e7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:29 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d" returned: 0 in 0.449s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:29 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d is being set with open permissions: ugo+rw Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:29 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d Jul 24 15:44:29 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:29 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d Jul 24 15:44:29 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:29 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d" returned: 0 in 0.298s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a9292d50-b381-4732-8e35-a570bc4b2030 tempest-VolumesDeleteCascade-1907189343 None] Create snapshot completed successfully Jul 24 15:44:29 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d" returned: 0 in 0.416s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:29 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d Jul 24 15:44:29 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-f70bf4ee-61c7-4697-bf57-d9dc995337b1-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:29 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-54487271-6a06-4c49-829c-3e454598537d" returned: 0 in 0.344s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-f70bf4ee-61c7-4697-bf57-d9dc995337b1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Lock "cinder-quobyte-54487271-6a06-4c49-829c-3e454598537d" released by "delete_volume" :: held 0.810s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Performing cascade delete. {{(pid=88251) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-a0711a23-cac8-4f5f-a792-18f6e1435f5d-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-a0711a23-cac8-4f5f-a792-18f6e1435f5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Created reservations ['f60445de-f016-4631-9c75-4614cc972621', '871a931f-63ee-4c61-b309-46721d7f4c07', '139bd279-af8c-4f1c-a10e-929f3da03115', '699dbe84-ddef-4c0a-819f-040d3d535cb6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-a0711a23-cac8-4f5f-a792-18f6e1435f5d" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-a0711a23-cac8-4f5f-a792-18f6e1435f5d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Deleting offline snapshot a0711a23-cac8-4f5f-a792-18f6e1435f5d of volume f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] snapshot_file for this snap is: volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[811ac7b7-166e-4397-b908-8f83c1e9e08b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:30 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:30 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:30 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d Jul 24 15:44:30 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:30 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.294s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Deleted volume successfully. Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-43f1154e-7b33-457b-90ea-a369757171c4 tempest-VolumesExtendTest-338207526 None] Lock "cinder-54487271-6a06-4c49-829c-3e454598537d-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:30 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d" returned: 0 in 0.507s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8264a010-323e-425d-9b59-12194a0f3cb1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Flow 'volume_create_manager' (848c8092-ccac-4dfd-847a-7724f74af238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9273e745-3c36-4542-9e6a-510961db57ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9273e745-3c36-4542-9e6a-510961db57ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1517711061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f939ae-9610-4277-9a1e-df799ee90ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cbe6b4bb98421a9a61776b72781eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:31Z,use_quota=True,user_id='b6cdc03dfda04d8ebad280e7deb903e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0783a589-a314-4d9f-9e54-fce5ee05ccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0783a589-a314-4d9f-9e54-fce5ee05ccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6e5bc9-ed7d-44ba-a9ea-6c59936c8116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6e5bc9-ed7d-44ba-a9ea-6c59936c8116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f939ae-9610-4277-9a1e-df799ee90ed7', 'volume_name': 'volume-b0f939ae-9610-4277-9a1e-df799ee90ed7', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:30 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 Jul 24 15:44:30 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a4b9b4-ee74-4e92-b73a-f017260cc858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a4b9b4-ee74-4e92-b73a-f017260cc858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa048782-5cdf-486c-a8fe-5557b4ff22b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:30 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Volume b0f939ae-9610-4277-9a1e-df799ee90ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f939ae-9610-4277-9a1e-df799ee90ed7', 'volume_size': 1} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1517711061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f939ae-9610-4277-9a1e-df799ee90ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cbe6b4bb98421a9a61776b72781eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:31Z,use_quota=True,user_id='b6cdc03dfda04d8ebad280e7deb903e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Creating volume b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:30 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:30 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 1073741824 Jul 24 15:44:30 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:31 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" returned: 0 in 0.431s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:31 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d Jul 24 15:44:31 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:31 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 1073741824" returned: 0 in 0.486s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:31 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 Jul 24 15:44:31 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:31 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d" returned: 0 in 0.412s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:31 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d Jul 24 15:44:31 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:31 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7" returned: 0 in 0.282s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa048782-5cdf-486c-a8fe-5557b4ff22b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f939ae-9610-4277-9a1e-df799ee90ed7', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1097a76a-64d5-46d4-a561-86d5b09d880a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:31 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Volume volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 (b0f939ae-9610-4277-9a1e-df799ee90ed7): created successfully Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1097a76a-64d5-46d4-a561-86d5b09d880a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Flow 'volume_create_manager' (848c8092-ccac-4dfd-847a-7724f74af238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-cd5f8f9d-8131-429a-86da-72afe080e84f tempest-VolumesExtendTest-338207526 None] Created volume successfully. Jul 24 15:44:31 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.a0711a23-cac8-4f5f-a792-18f6e1435f5d" returned: 0 in 0.259s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-a0711a23-cac8-4f5f-a792-18f6e1435f5d" released by "_delete_snapshot" :: held 1.727s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" released by "delete_snapshot" :: held 1.754s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:31 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Created reservations ['49309ab3-58bc-466a-b9bc-ba42d80921ca', '5eab07d5-be23-49f8-9beb-90d3eacb1bc8', '3a5ed562-95c3-412c-85cc-16807f1d9ffb', '43548b34-13a9-4e49-af89-c0df88bbffdb'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Delete snapshot completed successfully. Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-a0711a23-cac8-4f5f-a792-18f6e1435f5d-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-fe3bb0df-f1c3-477b-a145-7c2b549eb8a1-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-fe3bb0df-f1c3-477b-a145-7c2b549eb8a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Deleting offline snapshot fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 of volume f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] snapshot_file for this snap is: volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd33667-8d51-426e-8fd1-31db4782dddf]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:32 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 Jul 24 15:44:32 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:32 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" returned: 0 in 0.430s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80907ee-58e7-4a12-97ce-87b7b6f21c00]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:32 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 Jul 24 15:44:32 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:32 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1" returned: 0 in 0.387s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:33 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 Jul 24 15:44:33 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Creating offline snapshot aa7358d8-a598-4a75-87ab-42ff6ff92c0e of volume b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadc6d8d-f27b-49b3-ab0d-b16d3f4fe464]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:33 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 Jul 24 15:44:33 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:33 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" returned: 0 in 0.419s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:33 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1 Jul 24 15:44:33 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:33 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7" returned: 0 in 0.422s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:33 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e 1G Jul 24 15:44:33 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:33 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1.fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" returned: 0 in 0.361s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-fe3bb0df-f1c3-477b-a145-7c2b549eb8a1" released by "_delete_snapshot" :: held 1.738s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" released by "delete_snapshot" :: held 1.769s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:33 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Created reservations ['bf6094fc-08bb-482c-aac0-5c64235f997f', 'e9c97691-0c8a-424c-81a1-d0d6d8e16bea', 'ec903b6d-630f-42bf-bd9f-02e318557124', '138886fe-c21a-4bbb-b9b7-19a3b163a5ff'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:34 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Delete snapshot completed successfully. Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-fe3bb0df-f1c3-477b-a145-7c2b549eb8a1-delete_snapshot" released by "delete_snapshot" :: held 2.016s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Snapshots deleted, issuing volume delete {{(pid=88251) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1d9f63-9424-44a3-8ed9-1a302d5250b1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:34 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 Jul 24 15:44:34 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:34 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e 1G" returned: 0 in 0.664s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:34 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e Jul 24 15:44:34 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:34 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1" returned: 0 in 0.417s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:34 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1 Jul 24 15:44:34 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:34 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e" returned: 0 in 0.335s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:34 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e is being set with open permissions: ugo+rw Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:34 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e Jul 24 15:44:34 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:34 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:34 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:34 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f70bf4ee-61c7-4697-bf57-d9dc995337b1" returned: 0 in 0.294s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-f70bf4ee-61c7-4697-bf57-d9dc995337b1" released by "delete_volume" :: held 0.796s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:34 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e" returned: 0 in 0.274s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Created reservations ['f5495165-58db-40c8-a014-31d8dee44614', 'db2ef7aa-03bd-4c1a-9485-f1087f9bc496', '8b112dc0-e569-41ca-b9e7-893f23b6f304', 'c24c0e39-9b61-4f72-898d-078b47ec8356'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:35 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.info Jul 24 15:44:35 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:35 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:35 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:35 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.345s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 28 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:44:35 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.info" returned: 0 in 0.385s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:35 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.info is being set with open permissions: ugo+rw Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:35 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.info Jul 24 15:44:35 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:35 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.453s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Deleted volume successfully. Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a96a5729-6b00-464c-8cba-55b0d141d47a tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-f70bf4ee-61c7-4697-bf57-d9dc995337b1-delete_volume" released by "delete_volume" :: held 5.579s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:35 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.info" returned: 0 in 0.473s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.688s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-463300bb-e10a-4da8-b2fa-12301d45f381 tempest-VolumesExtendTest-338207526 None] Create snapshot completed successfully Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Flow 'volume_create_manager' (66a77ad1-92d5-4299-ade2-adb2073d0299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde9a61d-f498-4e98-8a16-909d72453985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ae5736a9-b36d-4e2a-b502-a3ad8f459648 tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ae5736a9-b36d-4e2a-b502-a3ad8f459648 tempest-VolumesExtendTest-338207526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde9a61d-f498-4e98-8a16-909d72453985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1452927976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62285409-48ea-4e8c-89cf-e63a8fac98b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea96e54b22f648919bf63fc09984ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:36Z,use_quota=True,user_id='6d1b28f96bf04eec855fc3e5aa507629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfba657-4974-4a4e-8fe0-1165f0a04b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfba657-4974-4a4e-8fe0-1165f0a04b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033c1a5f-9dac-4dc1-9a7c-a6b1f5443ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033c1a5f-9dac-4dc1-9a7c-a6b1f5443ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62285409-48ea-4e8c-89cf-e63a8fac98b4', 'volume_name': 'volume-62285409-48ea-4e8c-89cf-e63a8fac98b4', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e472985-6367-4274-b36c-80d0ff4ac9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e472985-6367-4274-b36c-80d0ff4ac9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621d4a48-26a7-46b5-b36e-efa272b66f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:36 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Volume 62285409-48ea-4e8c-89cf-e63a8fac98b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62285409-48ea-4e8c-89cf-e63a8fac98b4', 'volume_size': 1} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c25bdb-eff5-4c41-ac70-ca326fb94835]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ae5736a9-b36d-4e2a-b502-a3ad8f459648 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:36 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 Jul 24 15:44:36 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:37 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ae5736a9-b36d-4e2a-b502-a3ad8f459648 tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7" returned: 0 in 0.402s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ae5736a9-b36d-4e2a-b502-a3ad8f459648 tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e 2G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ae5736a9-b36d-4e2a-b502-a3ad8f459648 tempest-VolumesExtendTest-338207526 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e 2G" returned: 0 in 0.139s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ae5736a9-b36d-4e2a-b502-a3ad8f459648 tempest-VolumesExtendTest-338207526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.682s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1452927976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62285409-48ea-4e8c-89cf-e63a8fac98b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea96e54b22f648919bf63fc09984ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:36Z,use_quota=True,user_id='6d1b28f96bf04eec855fc3e5aa507629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Creating volume 62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:37 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:37 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 1073741824 Jul 24 15:44:37 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:37 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ae5736a9-b36d-4e2a-b502-a3ad8f459648 tempest-VolumesExtendTest-338207526 None] Extend volume completed successfully. Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Acquiring lock "cinder-aa7358d8-a598-4a75-87ab-42ff6ff92c0e-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Lock "cinder-aa7358d8-a598-4a75-87ab-42ff6ff92c0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Acquiring lock "cinder-quobyte-b0f939ae-9610-4277-9a1e-df799ee90ed7" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Lock "cinder-quobyte-b0f939ae-9610-4277-9a1e-df799ee90ed7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Acquiring lock "cinder-quobyte-aa7358d8-a598-4a75-87ab-42ff6ff92c0e" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:37 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 1073741824" returned: 0 in 0.515s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Lock "cinder-quobyte-aa7358d8-a598-4a75-87ab-42ff6ff92c0e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Deleting offline snapshot aa7358d8-a598-4a75-87ab-42ff6ff92c0e of volume b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] snapshot_file for this snap is: volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c51f80-8571-4dc9-8d56-f420d6d93101]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:37 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 Jul 24 15:44:37 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:38 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e Jul 24 15:44:38 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:38 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4" returned: 0 in 0.337s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621d4a48-26a7-46b5-b36e-efa272b66f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62285409-48ea-4e8c-89cf-e63a8fac98b4', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7637feeb-9c17-4abb-a06a-6fc3e5f011ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:38 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Volume volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 (62285409-48ea-4e8c-89cf-e63a8fac98b4): created successfully Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7637feeb-9c17-4abb-a06a-6fc3e5f011ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Flow 'volume_create_manager' (66a77ad1-92d5-4299-ade2-adb2073d0299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:38 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-4d9b4b6a-cc89-4718-b2b5-d2191fd08454 tempest-VolumesDeleteCascade-1907189343 None] Created volume successfully. Jul 24 15:44:38 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e" returned: 0 in 0.520s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0f939ae-9610-4277-9a1e-df799ee90ed7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07f8683-dc8a-4044-8130-3c765ac40792]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:38 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 Jul 24 15:44:38 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Creating offline snapshot 06d57509-517a-4054-b732-e2f8bbc493bd of volume 62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c966d586-ab4c-49f5-86ee-f8e216ed5703]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:39 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 Jul 24 15:44:39 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:39 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7" returned: 0 in 0.602s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:39 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e Jul 24 15:44:39 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:39 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4" returned: 0 in 0.570s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:39 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd 1G Jul 24 15:44:39 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:39 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e" returned: 0 in 0.537s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:39 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e Jul 24 15:44:39 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:39 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-9e12bcfc-db83-458c-8a3e-e348bf318d82 req-6e1dc946-7c1d-4b90-b135-4ba35d9ff55b tempest-AttachVolumeTestJSON-197735795 None] Terminate volume connection completed successfully. Jul 24 15:44:39 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-9e12bcfc-db83-458c-8a3e-e348bf318d82 req-6e1dc946-7c1d-4b90-b135-4ba35d9ff55b tempest-AttachVolumeTestJSON-197735795 None] Deleting attachment 51911b05-f085-480d-9b3a-00f161b17a63. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:44:40 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7.aa7358d8-a598-4a75-87ab-42ff6ff92c0e" returned: 0 in 0.571s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Lock "cinder-quobyte-aa7358d8-a598-4a75-87ab-42ff6ff92c0e" released by "_delete_snapshot" :: held 2.420s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Lock "cinder-quobyte-b0f939ae-9610-4277-9a1e-df799ee90ed7" released by "delete_snapshot" :: held 2.473s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:40 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd 1G" returned: 0 in 0.900s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:40 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd Jul 24 15:44:40 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Created reservations ['a062d521-2141-4478-8264-83211ad52b0b', '225a82df-2755-45b3-ab3a-af0b402774af', '1e8d5dae-69c7-4ade-9feb-e0b57874911d', '091fd709-7cbc-41b6-a402-6dc0cd34777c'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:40 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Delete snapshot completed successfully. Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c528ab48-2cbd-4b10-8b71-bc788fa81b9f tempest-VolumesExtendTest-338207526 None] Lock "cinder-aa7358d8-a598-4a75-87ab-42ff6ff92c0e-delete_snapshot" released by "delete_snapshot" :: held 2.815s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:40 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd" returned: 0 in 0.472s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:40 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd is being set with open permissions: ugo+rw Jul 24 15:44:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:40 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd Jul 24 15:44:40 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:41 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd" returned: 0 in 0.307s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Acquiring lock "cinder-b0f939ae-9610-4277-9a1e-df799ee90ed7-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Lock "cinder-b0f939ae-9610-4277-9a1e-df799ee90ed7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:41 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.info Jul 24 15:44:41 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Acquiring lock "cinder-quobyte-b0f939ae-9610-4277-9a1e-df799ee90ed7" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Lock "cinder-quobyte-b0f939ae-9610-4277-9a1e-df799ee90ed7" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39db0d0-a39d-466b-b3d6-3e27fb35efd5]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:41 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 Jul 24 15:44:41 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:41 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.info" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:41 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.info is being set with open permissions: ugo+rw Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:41 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.info Jul 24 15:44:41 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:41 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7" returned: 0 in 0.452s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:41 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.info" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:41 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7 Jul 24 15:44:41 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-42547bf6-52a1-4425-998d-de416248b783 tempest-VolumesDeleteCascade-1907189343 None] Create snapshot completed successfully Jul 24 15:44:42 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b0f939ae-9610-4277-9a1e-df799ee90ed7" returned: 0 in 0.343s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Lock "cinder-quobyte-b0f939ae-9610-4277-9a1e-df799ee90ed7" released by "delete_volume" :: held 0.888s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Created reservations ['cb6127f9-57dd-44f4-b54a-11bf9465323b', 'b7fa7690-1c08-401d-8918-f985f6f70074', 'f9b5300e-471d-4dff-b79e-bff774bed473', 'fb8efb0f-0581-4087-9a09-3fc04289273c'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:42 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:42 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:42 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.439s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Deleted volume successfully. Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c0e0fb-a65d-4e07-8226-2e459d7827bf tempest-VolumesExtendTest-338207526 None] Lock "cinder-b0f939ae-9610-4277-9a1e-df799ee90ed7-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Flow 'volume_create_manager' (ee728333-5c82-4d52-9bac-cc95456c6aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3659dcc1-b32c-4a6d-adee-ef6694bba5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3659dcc1-b32c-4a6d-adee-ef6694bba5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-524490132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e6f422-ae3d-421d-8a6d-bf1ab451b271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea96e54b22f648919bf63fc09984ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06d57509-517a-4054-b732-e2f8bbc493bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:43Z,use_quota=True,user_id='6d1b28f96bf04eec855fc3e5aa507629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab5c05d-a826-4f4f-b6d4-607b6f9ed4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab5c05d-a826-4f4f-b6d4-607b6f9ed4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e49a4aa-35f1-42fd-9b1f-96eac14cc498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e49a4aa-35f1-42fd-9b1f-96eac14cc498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6e6f422-ae3d-421d-8a6d-bf1ab451b271', 'volume_name': 'volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271', 'volume_size': 1, 'snapshot_id': '06d57509-517a-4054-b732-e2f8bbc493bd'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18de373-acc1-4bf2-88bd-7a66cf9960f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18de373-acc1-4bf2-88bd-7a66cf9960f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff45ce6-1664-49c5-a534-fcae5d98867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:43 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Volume b6e6f422-ae3d-421d-8a6d-bf1ab451b271: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271', 'volume_size': 1, 'snapshot_id': '06d57509-517a-4054-b732-e2f8bbc493bd'} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-06d57509-517a-4054-b732-e2f8bbc493bd-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-06d57509-517a-4054-b732-e2f8bbc493bd-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Creating volume b6e6f422-ae3d-421d-8a6d-bf1ab451b271 from snapshot 06d57509-517a-4054-b732-e2f8bbc493bd {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] snapshot: 06d57509-517a-4054-b732-e2f8bbc493bd, volume: b6e6f422-ae3d-421d-8a6d-bf1ab451b271, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa499af2-8eb8-4410-b536-2338ce4275e9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:43 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd Jul 24 15:44:43 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:43 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd" returned: 0 in 0.471s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62285409-48ea-4e8c-89cf-e63a8fac98b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0e18e0-c6aa-495a-a831-75251a5c3c8d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:43 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 Jul 24 15:44:43 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:44 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4" returned: 0 in 0.634s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:44 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:44:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:44 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 Jul 24 15:44:44 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:52 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" returned: 0 in 7.818s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:52 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e24445b-9e75-4810-9468-42ff7d506c40]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:52 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 Jul 24 15:44:52 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:52 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=53,cinder:INSERT=20,cinder:UPDATE=56,cinder:DELETE=3 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:53 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4" returned: 0 in 0.957s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:44:53 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Converted 1024.00 MB image at 130.95 MB/s Jul 24 15:44:53 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 is being set with open permissions: ugo+rw Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=55,cinder:UPDATE=56,cinder:DELETE=5,cinder:INSERT=15 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:53 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 Jul 24 15:44:53 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (04db92d3-1169-43e3-8392-6099c03ce1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1f4006-1378-45c8-b4d0-85bb14aff518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1f4006-1378-45c8-b4d0-85bb14aff518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1639529955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f056ed-e3ee-4cda-8f43-2ad032600712,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:53Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4adc1-79a5-47fd-88e3-db5cdc53fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4adc1-79a5-47fd-88e3-db5cdc53fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9f3ead-c6f8-42e7-92ce-42ec9290aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9f3ead-c6f8-42e7-92ce-42ec9290aace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f056ed-e3ee-4cda-8f43-2ad032600712', 'volume_name': 'volume-c5f056ed-e3ee-4cda-8f43-2ad032600712', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdb7ff5-81e6-4cf4-a408-1b18c6c2778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdb7ff5-81e6-4cf4-a408-1b18c6c2778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a41c0c2-29ab-4bf2-95dc-652271a7dae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:53 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Volume c5f056ed-e3ee-4cda-8f43-2ad032600712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f056ed-e3ee-4cda-8f43-2ad032600712', 'volume_size': 1} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:53 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" returned: 0 in 0.437s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" released by "_copy_volume_from_snapshot" :: held 10.455s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-06d57509-517a-4054-b732-e2f8bbc493bd-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" released by "_create_volume_from_snapshot" :: held 10.505s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.521s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1639529955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f056ed-e3ee-4cda-8f43-2ad032600712,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:53Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Creating volume c5f056ed-e3ee-4cda-8f43-2ad032600712 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:53 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:53 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 1073741824 Jul 24 15:44:53 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff45ce6-1664-49c5-a534-fcae5d98867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271', 'volume_size': 1, 'snapshot_id': '06d57509-517a-4054-b732-e2f8bbc493bd'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051c24a4-8a6d-4f97-aebd-b777f1f36869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:53 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Volume volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 (b6e6f422-ae3d-421d-8a6d-bf1ab451b271): created successfully Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051c24a4-8a6d-4f97-aebd-b777f1f36869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Flow 'volume_create_manager' (ee728333-5c82-4d52-9bac-cc95456c6aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fc0eedbb-a7ce-416e-a4f1-bbd44e329406 tempest-VolumesDeleteCascade-1907189343 None] Created volume successfully. Jul 24 15:44:54 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 1073741824" returned: 0 in 0.772s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:54 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 Jul 24 15:44:54 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-62285409-48ea-4e8c-89cf-e63a8fac98b4-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-62285409-48ea-4e8c-89cf-e63a8fac98b4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Performing cascade delete. {{(pid=88251) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-06d57509-517a-4054-b732-e2f8bbc493bd-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-06d57509-517a-4054-b732-e2f8bbc493bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-62285409-48ea-4e8c-89cf-e63a8fac98b4" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:54 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-62285409-48ea-4e8c-89cf-e63a8fac98b4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-06d57509-517a-4054-b732-e2f8bbc493bd" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a41c0c2-29ab-4bf2-95dc-652271a7dae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f056ed-e3ee-4cda-8f43-2ad032600712', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec692fb-d5f3-4a4e-8f27-a665c8ba0ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-06d57509-517a-4054-b732-e2f8bbc493bd" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Deleting offline snapshot 06d57509-517a-4054-b732-e2f8bbc493bd of volume 62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] snapshot_file for this snap is: volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:44:54 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Volume volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 (c5f056ed-e3ee-4cda-8f43-2ad032600712): created successfully Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec692fb-d5f3-4a4e-8f27-a665c8ba0ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (04db92d3-1169-43e3-8392-6099c03ce1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[961f70de-b091-4d80-93ef-a8915a8a13a8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9883b26d-27cf-4119-8ce9-81027cfeef00 tempest-VolumesGetTest-67100045 None] Created volume successfully. Jul 24 15:44:54 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd Jul 24 15:44:55 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:55 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd" returned: 0 in 0.463s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62285409-48ea-4e8c-89cf-e63a8fac98b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:44:55 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[56546427-353b-4fc2-8053-d1d4bb511a3b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:55 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 Jul 24 15:44:55 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:55 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4" returned: 0 in 0.583s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:56 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd Jul 24 15:44:56 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:56 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (3bbfbfc0-8fcd-4513-b258-bf9cdba53240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b8d525-31ba-4add-9ced-a2835a62e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd" returned: 0 in 0.692s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:56 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd Jul 24 15:44:56 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b8d525-31ba-4add-9ced-a2835a62e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2036232666',display_name='tempest-VolumesGetTest-Volume-557796688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3706c14-1444-4478-a073-b42187cfd64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:57Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ccb4a6-6376-4687-9955-fcdecea7d213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ccb4a6-6376-4687-9955-fcdecea7d213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc7a914-8d2f-4f82-bb6c-12b4871c8d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc7a914-8d2f-4f82-bb6c-12b4871c8d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3706c14-1444-4478-a073-b42187cfd64d', 'volume_name': 'volume-e3706c14-1444-4478-a073-b42187cfd64d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbfcd8a-9dde-4515-b67d-db4fb034d83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbfcd8a-9dde-4515-b67d-db4fb034d83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fd248a-4609-446c-a971-8109b62a84a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:56 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Volume e3706c14-1444-4478-a073-b42187cfd64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3706c14-1444-4478-a073-b42187cfd64d', 'volume_size': 1} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2036232666',display_name='tempest-VolumesGetTest-Volume-557796688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3706c14-1444-4478-a073-b42187cfd64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:57Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Creating volume e3706c14-1444-4478-a073-b42187cfd64d {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:56 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:44:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:56 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d 1073741824 Jul 24 15:44:56 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:57 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4.06d57509-517a-4054-b732-e2f8bbc493bd" returned: 0 in 0.411s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-06d57509-517a-4054-b732-e2f8bbc493bd" released by "_delete_snapshot" :: held 2.295s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-62285409-48ea-4e8c-89cf-e63a8fac98b4" released by "delete_snapshot" :: held 2.352s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Created reservations ['689c82f6-f25f-4431-83a1-8e9d5ae96e98', 'e1f90607-f918-41a5-b530-a92440217523', '8f9a2ddc-efcb-43fe-be4b-52f4a2601d6d', '1ae58563-b28a-49c4-a087-9548e2710ebc'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:57 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d 1073741824" returned: 0 in 0.843s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:57 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Delete snapshot completed successfully. Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-06d57509-517a-4054-b732-e2f8bbc493bd-delete_snapshot" released by "delete_snapshot" :: held 2.955s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Snapshots deleted, issuing volume delete {{(pid=88251) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-62285409-48ea-4e8c-89cf-e63a8fac98b4" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-62285409-48ea-4e8c-89cf-e63a8fac98b4" acquired by "delete_volume" :: waited 0.140s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:57 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d Jul 24 15:44:57 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[619cc3a6-096f-4773-84b0-ea4c6234b8b8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:58 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d" returned: 0 in 0.514s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:58 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 Jul 24 15:44:58 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fd248a-4609-446c-a971-8109b62a84a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3706c14-1444-4478-a073-b42187cfd64d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b264842-72ad-42b0-9701-86c4e3235ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:58 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Volume volume-e3706c14-1444-4478-a073-b42187cfd64d (e3706c14-1444-4478-a073-b42187cfd64d): created successfully Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b264842-72ad-42b0-9701-86c4e3235ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (3bbfbfc0-8fcd-4513-b258-bf9cdba53240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f94f78d9-94d5-4c10-a510-f4cf8df7cb9a tempest-VolumesGetTest-67100045 None] Created volume successfully. Jul 24 15:44:58 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4" returned: 0 in 0.888s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:58 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4 Jul 24 15:44:58 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-e3706c14-1444-4478-a073-b42187cfd64d-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Lock "cinder-e3706c14-1444-4478-a073-b42187cfd64d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-e3706c14-1444-4478-a073-b42187cfd64d" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-e3706c14-1444-4478-a073-b42187cfd64d" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2e3d45-b440-40ad-9d1c-14454349c0ae]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:59 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d Jul 24 15:44:59 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:59 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62285409-48ea-4e8c-89cf-e63a8fac98b4" returned: 0 in 0.524s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-62285409-48ea-4e8c-89cf-e63a8fac98b4" released by "delete_volume" :: held 1.619s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Created reservations ['464db91d-091c-4590-aaee-0534830d41df', '407a2e43-c033-4b26-8405-536b0f6c15ae', '682a2cd3-b917-48f5-82dc-79002745fd0a', '39ff7b43-c993-4cb7-ae00-d2b4a46b1aa9'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:59 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:44:59 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:59 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d" returned: 0 in 0.591s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:59 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d Jul 24 15:44:59 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:00 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.393s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Deleted volume successfully. Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-110d2f3c-51c2-4f6f-ad79-18ceba995981 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-62285409-48ea-4e8c-89cf-e63a8fac98b4-delete_volume" released by "delete_volume" :: held 5.432s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:00 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e3706c14-1444-4478-a073-b42187cfd64d" returned: 0 in 0.357s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-e3706c14-1444-4478-a073-b42187cfd64d" released by "delete_volume" :: held 1.015s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Created reservations ['f7c636b8-be6a-4e79-aabd-eec69b747c8a', 'ac8b612c-4d7c-454a-97b1-7bd96832a25d', '3e535c8e-9c7b-493e-bb9f-d1a1962b92a9', '245357f4-9b05-428c-baed-5ad507c3a33c'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:00 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:00 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-b6e6f422-ae3d-421d-8a6d-bf1ab451b271-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-b6e6f422-ae3d-421d-8a6d-bf1ab451b271-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "cinder-quobyte-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" acquired by "delete_volume" :: waited 0.032s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4466bae-d753-456d-a20d-274fec91cd31]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:00 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.490s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:00 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Deleted volume successfully. Jul 24 15:45:00 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 Jul 24 15:45:00 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9df01a54-bb83-49a0-bc2b-730a702104db tempest-VolumesGetTest-67100045 None] Lock "cinder-e3706c14-1444-4478-a073-b42187cfd64d-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-c5f056ed-e3ee-4cda-8f43-2ad032600712-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:01 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" returned: 0 in 0.905s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Lock "cinder-c5f056ed-e3ee-4cda-8f43-2ad032600712-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-c5f056ed-e3ee-4cda-8f43-2ad032600712" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:01 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271 Jul 24 15:45:01 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-c5f056ed-e3ee-4cda-8f43-2ad032600712" acquired by "delete_volume" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[36157ce9-eb1f-4bff-9753-9d96a18aa95c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:01 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 Jul 24 15:45:01 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:02 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" returned: 0 in 0.366s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-quobyte-b6e6f422-ae3d-421d-8a6d-bf1ab451b271" released by "delete_volume" :: held 1.330s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Created reservations ['96cf446d-aba9-43a0-853a-d3353c42770a', '7c970684-2595-4701-a40d-57abf8fabae5', '8213be96-42e0-41ab-bf90-88e6c1e89cab', '362beb15-0ed0-4036-be5b-76838df72a12'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:02 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:02 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:02 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712" returned: 0 in 0.510s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:02 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712 Jul 24 15:45:02 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:02 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.330s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:02 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Deleted volume successfully. Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c7595b2f-b27b-4a7c-99a3-7955e7f943e7 tempest-VolumesDeleteCascade-1907189343 None] Lock "cinder-b6e6f422-ae3d-421d-8a6d-bf1ab451b271-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:02 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5f056ed-e3ee-4cda-8f43-2ad032600712" returned: 0 in 0.325s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-c5f056ed-e3ee-4cda-8f43-2ad032600712" released by "delete_volume" :: held 0.928s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:02 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Created reservations ['00e10142-c04a-4cb3-9fb0-f57fa18e66a2', '83323a16-adcf-4249-a45f-44169dc6725a', 'ca67bc98-b670-4798-b9f5-23f1798a510b', 'd6e25a86-df3e-41b6-abe4-f4a9dd042594'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:03 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:03 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:03 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.375s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:03 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Deleted volume successfully. Jul 24 15:45:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be4e6510-88dd-4ffd-a25e-e91c6786f2a0 tempest-VolumesGetTest-67100045 None] Lock "cinder-c5f056ed-e3ee-4cda-8f43-2ad032600712-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (adfb7e87-a2ef-4482-a0f3-ef3fbfc8938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b7d6c3-09e1-4907-aaf0-05733e5361c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b7d6c3-09e1-4907-aaf0-05733e5361c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-557144290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9c5e5d-3ee7-4029-bc18-2ad83440bae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:05Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd20f29-63bf-422e-ab99-cabd0555635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd20f29-63bf-422e-ab99-cabd0555635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90c96ec-6268-40f9-aaa5-64f67591dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90c96ec-6268-40f9-aaa5-64f67591dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9c5e5d-3ee7-4029-bc18-2ad83440bae8', 'volume_name': 'volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e974e378-ddf0-4002-98ac-08285d1d29ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e974e378-ddf0-4002-98ac-08285d1d29ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6ac1d6-9962-4b05-8edb-c196ae09b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:04 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Volume 7d9c5e5d-3ee7-4029-bc18-2ad83440bae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8', 'volume_size': 1} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-557144290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9c5e5d-3ee7-4029-bc18-2ad83440bae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:05Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Creating volume 7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:04 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:45:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:04 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 1073741824 Jul 24 15:45:04 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:05 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 1073741824" returned: 0 in 0.538s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:05 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 Jul 24 15:45:05 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:05 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" returned: 0 in 0.359s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6ac1d6-9962-4b05-8edb-c196ae09b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60415d9-ae9f-4dc5-81e7-e5404ac3c0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Volume volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 (7d9c5e5d-3ee7-4029-bc18-2ad83440bae8): created successfully Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60415d9-ae9f-4dc5-81e7-e5404ac3c0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (adfb7e87-a2ef-4482-a0f3-ef3fbfc8938c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a6b12dd1-56cb-4bb8-8b57-25ee95f323ea tempest-VolumesGetTest-67100045 None] Created volume successfully. Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (0fe7f1dd-fc35-45c9-b621-85914c986dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f5c28f-7972-444f-a61c-89aa780045f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f5c28f-7972-444f-a61c-89aa780045f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-808582543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556fb358-59ae-4ab3-9176-24866360f7a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7d9c5e5d-3ee7-4029-bc18-2ad83440bae8,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:07Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4717600e-c43d-4b26-bc19-bd6fbc49a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4717600e-c43d-4b26-bc19-bd6fbc49a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c092c50a-0c6a-4ed6-b950-b2828bb00a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c092c50a-0c6a-4ed6-b950-b2828bb00a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '556fb358-59ae-4ab3-9176-24866360f7a4', 'volume_name': 'volume-556fb358-59ae-4ab3-9176-24866360f7a4', 'volume_size': 1, 'source_volid': '7d9c5e5d-3ee7-4029-bc18-2ad83440bae8', 'source_volstatus': 'available'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5690c8bc-663b-46c3-a55c-14e681180c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5690c8bc-663b-46c3-a55c-14e681180c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f62bbb-d234-45ae-8c7b-5bf664763e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:07 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Volume 556fb358-59ae-4ab3-9176-24866360f7a4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-556fb358-59ae-4ab3-9176-24866360f7a4', 'volume_size': 1, 'source_volid': '7d9c5e5d-3ee7-4029-bc18-2ad83440bae8', 'source_volstatus': 'available'} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:07 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Cloning volume 7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 to volume 556fb358-59ae-4ab3-9176-24866360f7a4 Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Creating offline snapshot 1f457b48-65be-4155-936c-7007a303bafd of volume 7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb05a91-3e13-4c2f-991a-8ffd6ff69fc9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:07 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 Jul 24 15:45:07 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:08 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" returned: 0 in 0.430s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:08 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd 1G Jul 24 15:45:08 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:08 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd 1G" returned: 0 in 0.472s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:08 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd Jul 24 15:45:08 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:08 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd" returned: 0 in 0.340s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:08 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd is being set with open permissions: ugo+rw Jul 24 15:45:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:09 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd Jul 24 15:45:09 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:09 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd" returned: 0 in 0.286s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:09 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.info Jul 24 15:45:09 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:09 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.info" returned: 0 in 0.295s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:09 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.info is being set with open permissions: ugo+rw Jul 24 15:45:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:09 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.info Jul 24 15:45:09 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:09 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.info" returned: 0 in 0.356s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-556fb358-59ae-4ab3-9176-24866360f7a4" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-556fb358-59ae-4ab3-9176-24866360f7a4" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] snapshot: 1f457b48-65be-4155-936c-7007a303bafd, volume: 556fb358-59ae-4ab3-9176-24866360f7a4, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f6a78-7dd6-411c-b35c-4832a9d8f0b7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:10 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd Jul 24 15:45:10 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:10 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd" returned: 0 in 0.524s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5841e6b7-5d72-43ac-888d-cd3b27f29508]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:10 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 Jul 24 15:45:10 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:11 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" returned: 0 in 0.455s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:11 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:45:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:11 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 Jul 24 15:45:11 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4" returned: 0 in 7.228s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:18 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf3240-6832-4053-99dc-34ab891a2b89]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:18 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 Jul 24 15:45:18 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:19 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" returned: 0 in 0.724s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:45:19 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Converted 1024.00 MB image at 141.65 MB/s Jul 24 15:45:19 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 is being set with open permissions: ugo+rw Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:19 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 Jul 24 15:45:19 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=36,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=11 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:45:19 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4" returned: 0 in 0.319s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-556fb358-59ae-4ab3-9176-24866360f7a4" released by "_copy_volume_from_snapshot" :: held 9.364s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-1f457b48-65be-4155-936c-7007a303bafd" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-1f457b48-65be-4155-936c-7007a303bafd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Deleting offline snapshot 1f457b48-65be-4155-936c-7007a303bafd of volume 7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] snapshot_file for this snap is: volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[50417165-88a8-43d6-95b0-a0c313c20432]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:19 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd Jul 24 15:45:19 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:19 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd" returned: 0 in 0.410s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0671d3-26ae-4b87-95b8-c36c7340f626]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:20 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 Jul 24 15:45:20 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:20 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" returned: 0 in 0.505s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:20 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd Jul 24 15:45:20 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:20 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd" returned: 0 in 0.568s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:21 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd Jul 24 15:45:21 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:21 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8.1f457b48-65be-4155-936c-7007a303bafd" returned: 0 in 0.442s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-1f457b48-65be-4155-936c-7007a303bafd" released by "_delete_snapshot" :: held 2.090s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.938s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f62bbb-d234-45ae-8c7b-5bf664763e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556fb358-59ae-4ab3-9176-24866360f7a4', 'volume_size': 1, 'source_volid': '7d9c5e5d-3ee7-4029-bc18-2ad83440bae8', 'source_volstatus': 'available'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb17c07-f986-4e37-92b9-4b2b4c08c4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Volume volume-556fb358-59ae-4ab3-9176-24866360f7a4 (556fb358-59ae-4ab3-9176-24866360f7a4): created successfully Jul 24 15:45:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb17c07-f986-4e37-92b9-4b2b4c08c4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (0fe7f1dd-fc35-45c9-b621-85914c986dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:21 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-defddb82-14f0-4f48-a567-9ef28b66e234 tempest-VolumesGetTest-67100045 None] Created volume successfully. Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (18a1cde8-e0a6-4ccf-a2eb-de018dceb824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbc1117-b230-42ba-a73f-e1ab3bef3529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbc1117-b230-42ba-a73f-e1ab3bef3529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1790392794',display_name='tempest-VolumesGetTest-Volume-1980287737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7340ff-aba1-4028-add4-9aa44574cdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:23Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5f48c-5263-4977-aeec-7ceef1e94f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5f48c-5263-4977-aeec-7ceef1e94f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061746c0-99e1-4b9e-9b78-9b342f4ee76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061746c0-99e1-4b9e-9b78-9b342f4ee76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7340ff-aba1-4028-add4-9aa44574cdb1', 'volume_name': 'volume-6e7340ff-aba1-4028-add4-9aa44574cdb1', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a4a7cc-afc5-4637-abaa-659ae1be9009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a4a7cc-afc5-4637-abaa-659ae1be9009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5733c863-5e44-4824-8454-dc72cc552a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:23 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Volume 6e7340ff-aba1-4028-add4-9aa44574cdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7340ff-aba1-4028-add4-9aa44574cdb1', 'volume_size': 1} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1790392794',display_name='tempest-VolumesGetTest-Volume-1980287737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7340ff-aba1-4028-add4-9aa44574cdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:23Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Creating volume 6e7340ff-aba1-4028-add4-9aa44574cdb1 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:23 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:23 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 1073741824 Jul 24 15:45:23 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:23 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 1073741824" returned: 0 in 0.497s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:24 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 Jul 24 15:45:24 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:24 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Flow 'volume_create_manager' (48741e31-8dd1-43ee-a73b-62ccf96fffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1a2de0-be99-4dc5-ad84-457da66f9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1" returned: 0 in 0.365s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1a2de0-be99-4dc5-ad84-457da66f9aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-762998470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0b666f-c5cf-4ea8-b813-532dd392dd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a97c89fa84481cb35273da8f92a91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:24Z,use_quota=True,user_id='92b7fcb662424ed99c5060b3ea0c5a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fc7714-2268-45f4-9448-09db5141fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fc7714-2268-45f4-9448-09db5141fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65a2ccc-5e79-4247-b6a6-b777308821d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65a2ccc-5e79-4247-b6a6-b777308821d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0b666f-c5cf-4ea8-b813-532dd392dd2d', 'volume_name': 'volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0c81d8-53f9-4224-a44d-0183534f32e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0c81d8-53f9-4224-a44d-0183534f32e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcf1e1a-f49c-4093-9f73-04d8a5e3c6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:24 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Volume 5e0b666f-c5cf-4ea8-b813-532dd392dd2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d', 'volume_size': 1} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-762998470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0b666f-c5cf-4ea8-b813-532dd392dd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a97c89fa84481cb35273da8f92a91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:24Z,use_quota=True,user_id='92b7fcb662424ed99c5060b3ea0c5a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Creating volume 5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:24 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5733c863-5e44-4824-8454-dc72cc552a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7340ff-aba1-4028-add4-9aa44574cdb1', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c0789a-eb74-46e1-93d6-9c28d3b819ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:24 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d 1073741824 Jul 24 15:45:24 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:24 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Volume volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 (6e7340ff-aba1-4028-add4-9aa44574cdb1): created successfully Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c0789a-eb74-46e1-93d6-9c28d3b819ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (18a1cde8-e0a6-4ccf-a2eb-de018dceb824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a5cae740-10ca-4a94-b4ef-a1fab123e826 tempest-VolumesGetTest-67100045 None] Created volume successfully. Jul 24 15:45:24 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d 1073741824" returned: 0 in 0.440s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:24 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:45:24 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:25 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcf1e1a-f49c-4093-9f73-04d8a5e3c6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7d29ad-d2ca-47be-b1c8-de663b328082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Volume volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d (5e0b666f-c5cf-4ea8-b813-532dd392dd2d): created successfully Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7d29ad-d2ca-47be-b1c8-de663b328082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Flow 'volume_create_manager' (48741e31-8dd1-43ee-a73b-62ccf96fffed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e1a7f805-1f75-4290-a860-289ab5e2e676 tempest-VolumesActionsTest-1011356962 None] Created volume successfully. Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-6e7340ff-aba1-4028-add4-9aa44574cdb1-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Lock "cinder-6e7340ff-aba1-4028-add4-9aa44574cdb1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-6e7340ff-aba1-4028-add4-9aa44574cdb1" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-6e7340ff-aba1-4028-add4-9aa44574cdb1" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd52de-d8f4-4621-8d49-bf2557a0e9a7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:25 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 Jul 24 15:45:25 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Flow 'volume_create_manager' (cedef811-f696-473f-89ba-09be07dbf748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d01ff89-ede1-4596-953c-0da05f6ae973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d01ff89-ede1-4596-953c-0da05f6ae973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1902623602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a3d2d4-2823-43d6-866a-324c22cace97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5adfb6121124fe7a92f2181ad26f5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:26Z,use_quota=True,user_id='ec238608b2284dd3ad837cb0f38feeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94ae279-3e57-4df0-a2b8-368225f246e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94ae279-3e57-4df0-a2b8-368225f246e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a03363d-7a1c-4fdf-9fbf-d793edf575e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a03363d-7a1c-4fdf-9fbf-d793edf575e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a3d2d4-2823-43d6-866a-324c22cace97', 'volume_name': 'volume-a6a3d2d4-2823-43d6-866a-324c22cace97', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230f466a-018c-4003-905c-93da00e8c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230f466a-018c-4003-905c-93da00e8c727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436f2456-ebd4-4f8c-a746-11cefe77dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Volume a6a3d2d4-2823-43d6-866a-324c22cace97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a3d2d4-2823-43d6-866a-324c22cace97', 'volume_size': 1} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1902623602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a3d2d4-2823-43d6-866a-324c22cace97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5adfb6121124fe7a92f2181ad26f5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:26Z,use_quota=True,user_id='ec238608b2284dd3ad837cb0f38feeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Creating volume a6a3d2d4-2823-43d6-866a-324c22cace97 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:26 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:26 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 1073741824 Jul 24 15:45:26 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:26 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1" returned: 0 in 0.576s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:26 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1 Jul 24 15:45:26 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:26 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6e7340ff-aba1-4028-add4-9aa44574cdb1" returned: 0 in 0.370s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-6e7340ff-aba1-4028-add4-9aa44574cdb1" released by "delete_volume" :: held 1.033s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:26 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Created reservations ['e1c2b269-8c1c-4cc2-8ac4-7d88e791575e', 'f328a14e-aaf9-4d9f-b193-7bf89eb6b6e9', '8e49d306-0940-4acc-a3d5-9575dd53df73', '1ece3a50-a35d-4207-a25e-34411241a49d'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:27 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:27 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:27 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 1073741824" returned: 0 in 0.809s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:27 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 Jul 24 15:45:27 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:27 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.486s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Deleted volume successfully. Jul 24 15:45:27 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97" returned: 0 in 0.395s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f73f4579-fe7a-4eff-b3f7-7eff4fa4f79f tempest-VolumesGetTest-67100045 None] Lock "cinder-6e7340ff-aba1-4028-add4-9aa44574cdb1-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436f2456-ebd4-4f8c-a746-11cefe77dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a3d2d4-2823-43d6-866a-324c22cace97', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24da8390-d4b3-4f78-b40f-8500f862bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:27 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Volume volume-a6a3d2d4-2823-43d6-866a-324c22cace97 (a6a3d2d4-2823-43d6-866a-324c22cace97): created successfully Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24da8390-d4b3-4f78-b40f-8500f862bc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Flow 'volume_create_manager' (cedef811-f696-473f-89ba-09be07dbf748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7502f1b3-7d11-4377-9b6f-b54651ca0b57 tempest-AttachVolumeNegativeTest-553811594 None] Created volume successfully. Jul 24 15:45:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-556fb358-59ae-4ab3-9176-24866360f7a4-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Lock "cinder-556fb358-59ae-4ab3-9176-24866360f7a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-556fb358-59ae-4ab3-9176-24866360f7a4" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-556fb358-59ae-4ab3-9176-24866360f7a4" acquired by "delete_volume" :: waited 0.057s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:28 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb18fe66-42da-4ad6-a597-afd6ea317d2a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:28 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 Jul 24 15:45:28 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:28 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4" returned: 0 in 0.483s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:28 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4 Jul 24 15:45:28 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:29 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-556fb358-59ae-4ab3-9176-24866360f7a4" returned: 0 in 0.428s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-556fb358-59ae-4ab3-9176-24866360f7a4" released by "delete_volume" :: held 1.003s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Created reservations ['543981f4-7f3a-45a5-bd52-4840f1604704', '96d0fece-ddf0-48f6-a1a1-4490d0588690', '5afc95b6-e033-4a08-b83e-85e0eb264d77', 'a34cced1-19ef-43ff-856b-75a14a6f3f05'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:29 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:29 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-3429bbb3-1740-492e-b16d-569c3e8bbf22 req-79649fcb-45be-426c-9d92-37814119d6ac tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-3429bbb3-1740-492e-b16d-569c3e8bbf22 req-79649fcb-45be-426c-9d92-37814119d6ac tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-3429bbb3-1740-492e-b16d-569c3e8bbf22 req-79649fcb-45be-426c-9d92-37814119d6ac tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-3429bbb3-1740-492e-b16d-569c3e8bbf22 req-79649fcb-45be-426c-9d92-37814119d6ac tempest-AttachVolumeNegativeTest-553811594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-a6a3d2d4-2823-43d6-866a-324c22cace97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d954e0f-5f28-4542-98ae-7177854ca755', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:45:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-3429bbb3-1740-492e-b16d-569c3e8bbf22 req-79649fcb-45be-426c-9d92-37814119d6ac tempest-AttachVolumeNegativeTest-553811594 None] attachment_update completed successfully. Jul 24 15:45:30 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.581s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Deleted volume successfully. Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44ca88d8-7b72-4ffd-b5f5-140d6bd71dcd tempest-VolumesGetTest-67100045 None] Lock "cinder-556fb358-59ae-4ab3-9176-24866360f7a4-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Lock "cinder-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95e157c-b1bd-4999-b3f9-612f7fae6ff1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:31 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 Jul 24 15:45:31 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:31 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" returned: 0 in 0.631s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:31 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8 Jul 24 15:45:31 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:32 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" returned: 0 in 0.595s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8" released by "delete_volume" :: held 1.341s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Created reservations ['51f6601a-e973-44aa-ae8c-04f16532c18b', 'dde52762-536e-4192-8cb8-6f971eb882a5', '5c4ba178-588b-4849-aefe-e703f241c9fd', 'af1bf01c-e81b-476a-9e74-aa9feb98c2be'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:32 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:32 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:32 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.393s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Deleted volume successfully. Jul 24 15:45:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eb8b7fb1-88a1-44dd-9ba8-7563ebcd3579 tempest-VolumesGetTest-67100045 None] Lock "cinder-7d9c5e5d-3ee7-4029-bc18-2ad83440bae8-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (9bec9580-7a87-4607-a377-2c5d77234fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2117798-a3ed-4c23-856c-fea4361015bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2117798-a3ed-4c23-856c-fea4361015bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-492577056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e85e868-c9ea-454b-9049-111a732d967d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:34Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b4ce16-5566-4d08-bf5e-49fd395850f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b4ce16-5566-4d08-bf5e-49fd395850f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64e4f6b-db7b-4229-beaa-b1f0c7300940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:34 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:34 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64e4f6b-db7b-4229-beaa-b1f0c7300940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e85e868-c9ea-454b-9049-111a732d967d', 'volume_name': 'volume-3e85e868-c9ea-454b-9049-111a732d967d', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f1d252-7736-4547-ac19-bf2a8f9b2f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f1d252-7736-4547-ac19-bf2a8f9b2f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c87d285-b168-4174-84e7-46f69d8fd22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:35 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Volume 3e85e868-c9ea-454b-9049-111a732d967d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e85e868-c9ea-454b-9049-111a732d967d', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Trying to clone 3e85e868-c9ea-454b-9049-111a732d967d from image 2edfa101-a293-4451-bf18-908a0ec01fd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:45:35 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.883s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 28 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:45:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:45:36 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD, size 20.69 MB, duration 1.20 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:45:36 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Image download 20.69 MB at 17.27 MB/s Jul 24 15:45:36 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1cbe0-5877-4f0f-ad85-2be5da214961]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:36 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD Jul 24 15:45:36 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:37 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD" returned: 0 in 1.077s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:37 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Temporary image 2edfa101-a293-4451-bf18-908a0ec01fd6 is fetched for user 5783ddeadc0e47838937a7a6e02c053e. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:45:37 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[130167dd-1449-4777-9e12-674d066f811d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:38 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD Jul 24 15:45:38 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:38 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-492577056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e85e868-c9ea-454b-9049-111a732d967d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:34Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Creating volume 3e85e868-c9ea-454b-9049-111a732d967d {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:38 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:45:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:38 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d 1073741824 Jul 24 15:45:38 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:39 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d 1073741824" returned: 0 in 1.264s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:40 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d Jul 24 15:45:40 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:40 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d" returned: 0 in 0.570s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:40 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Attempting download of 2edfa101-a293-4451-bf18-908a0ec01fd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}])) to volume 3e85e868-c9ea-454b-9049-111a732d967d. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:45:40 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7daa18-4552-4e3d-9fb8-b1638df590a2]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_2xzhp0fb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:40 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_2xzhp0fb Jul 24 15:45:40 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:41 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d79ff79b-7b83-4bcc-824f-2f3d296f9fe0 tempest-VolumesActionsTest-1011356962 None] Acquiring lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" by "attach_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_2xzhp0fb" returned: 0 in 0.780s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_2xzhp0fb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d79ff79b-7b83-4bcc-824f-2f3d296f9fe0 tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" acquired by "attach_volume" :: waited 0.146s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:41 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_2xzhp0fb Jul 24 15:45:41 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d79ff79b-7b83-4bcc-824f-2f3d296f9fe0 tempest-VolumesActionsTest-1011356962 None] Attaching volume 5e0b666f-c5cf-4ea8-b813-532dd392dd2d to instance 6776fa48-72fc-4c83-a805-d827f85c5bb6 at mountpoint /dev/vdb on host None. Jul 24 15:45:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d79ff79b-7b83-4bcc-824f-2f3d296f9fe0 tempest-VolumesActionsTest-1011356962 None] Attach volume completed successfully. Jul 24 15:45:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d79ff79b-7b83-4bcc-824f-2f3d296f9fe0 tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" released by "attach_volume" :: held 0.257s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fbaac9fe-455d-4ce4-885f-490c18183faa tempest-VolumesActionsTest-1011356962 None] Acquiring lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-detach_volume" by "detach_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fbaac9fe-455d-4ce4-885f-490c18183faa tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fbaac9fe-455d-4ce4-885f-490c18183faa tempest-VolumesActionsTest-1011356962 None] Detaching volume 5e0b666f-c5cf-4ea8-b813-532dd392dd2d from instance 6776fa48-72fc-4c83-a805-d827f85c5bb6. Jul 24 15:45:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fbaac9fe-455d-4ce4-885f-490c18183faa tempest-VolumesActionsTest-1011356962 None] Detach volume completed successfully. Jul 24 15:45:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fbaac9fe-455d-4ce4-885f-490c18183faa tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:42 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_2xzhp0fb" returned: 1 in 0.790s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_2xzhp0fb' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:45:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac163d47-d829-4fff-be40-93b3029168c8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:42 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD Jul 24 15:45:42 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:43 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD" returned: 0 in 0.914s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:43 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] 2edfa101-a293-4451-bf18-908a0ec01fd6 was qcow2, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:45:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:43 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d Jul 24 15:45:43 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:46 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d" returned: 0 in 3.513s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:46 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_df49_ltqdevstack@QuobyteHD, size 112.00 MB, duration 3.51 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:45:46 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Converted 112.00 MB image at 31.87 MB/s Jul 24 15:45:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:46 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d 1G Jul 24 15:45:46 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:47 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d 1G" returned: 0 in 0.494s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Downloaded image 2edfa101-a293-4451-bf18-908a0ec01fd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}])) to volume 3e85e868-c9ea-454b-9049-111a732d967d successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Temporary image 2edfa101-a293-4451-bf18-908a0ec01fd6 for user 5783ddeadc0e47838937a7a6e02c053e is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Marking volume 3e85e868-c9ea-454b-9049-111a732d967d as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Copying metadata from image 2edfa101-a293-4451-bf18-908a0ec01fd6 to 3e85e868-c9ea-454b-9049-111a732d967d. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Creating volume glance metadata for volume 3e85e868-c9ea-454b-9049-111a732d967d backed by image 2edfa101-a293-4451-bf18-908a0ec01fd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c87d285-b168-4174-84e7-46f69d8fd22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e85e868-c9ea-454b-9049-111a732d967d', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193a78ca-01c0-4531-9803-0ece15d8fcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:47 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Volume volume-3e85e868-c9ea-454b-9049-111a732d967d (3e85e868-c9ea-454b-9049-111a732d967d): created successfully Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193a78ca-01c0-4531-9803-0ece15d8fcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (9bec9580-7a87-4607-a377-2c5d77234fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:47 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f1fcdf31-d6c6-498b-a6bb-7a2277a4a497 tempest-VolumesGetTest-67100045 None] Created volume successfully. Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (6f3cd0b0-26f9-4df1-86cf-bf7345e4afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb07483-2b0c-416e-9151-6e536ddbe35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb07483-2b0c-416e-9151-6e536ddbe35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1885353079',display_name='tempest-VolumesGetTest-Volume-904569445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3fea1f-c0ef-45d0-bad0-f892f20e153d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:50Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642da7d4-1242-44c1-aae0-08f448658068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642da7d4-1242-44c1-aae0-08f448658068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b765f374-78a0-496a-afab-6ead563acda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b765f374-78a0-496a-afab-6ead563acda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3fea1f-c0ef-45d0-bad0-f892f20e153d', 'volume_name': 'volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b91aeec-e6c8-4df4-a994-72166a247878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b91aeec-e6c8-4df4-a994-72166a247878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbe1beb-d895-42e9-91e7-8e4fdbe8db2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Volume 5b3fea1f-c0ef-45d0-bad0-f892f20e153d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d', 'volume_size': 1} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1885353079',display_name='tempest-VolumesGetTest-Volume-904569445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3fea1f-c0ef-45d0-bad0-f892f20e153d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d7f9efced841dab965cf9c3b4bb61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:50Z,use_quota=True,user_id='5783ddeadc0e47838937a7a6e02c053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Creating volume 5b3fea1f-c0ef-45d0-bad0-f892f20e153d {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:49 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:45:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:50 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d 1073741824 Jul 24 15:45:50 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:50 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d 1073741824" returned: 0 in 0.729s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:50 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d Jul 24 15:45:50 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:51 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d" returned: 0 in 0.310s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbe1beb-d895-42e9-91e7-8e4fdbe8db2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330c5c2f-3d9f-492c-8602-652b35136e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Volume volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d (5b3fea1f-c0ef-45d0-bad0-f892f20e153d): created successfully Jul 24 15:45:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330c5c2f-3d9f-492c-8602-652b35136e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Flow 'volume_create_manager' (6f3cd0b0-26f9-4df1-86cf-bf7345e4afb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2b78b27b-3f73-4423-8b9d-c84c6e8799a2 tempest-VolumesGetTest-67100045 None] Created volume successfully. Jul 24 15:45:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-5b3fea1f-c0ef-45d0-bad0-f892f20e153d-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Lock "cinder-5b3fea1f-c0ef-45d0-bad0-f892f20e153d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-5b3fea1f-c0ef-45d0-bad0-f892f20e153d" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-5b3fea1f-c0ef-45d0-bad0-f892f20e153d" acquired by "delete_volume" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:52 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e4198-314a-41d8-a0fd-4cfb26b79bfd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:52 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d Jul 24 15:45:52 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:53 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d" returned: 0 in 0.554s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:53 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d Jul 24 15:45:53 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:53 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5b3fea1f-c0ef-45d0-bad0-f892f20e153d" returned: 0 in 0.493s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-5b3fea1f-c0ef-45d0-bad0-f892f20e153d" released by "delete_volume" :: held 1.133s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=102,cinder:SELECT=93,cinder:DELETE=4,cinder:INSERT=31 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Created reservations ['fe9de73a-507a-4751-a2a4-adb4d0e22375', 'e202fe48-2954-4b1c-be45-fcd10279361e', 'e893390c-67dc-43e9-9faf-625a45d76e2a', '91157cc9-5351-4d85-93e8-cd7ff5c1f293'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:54 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:54 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:54 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.337s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:54 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Deleted volume successfully. Jul 24 15:45:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98f4c12c-059f-499d-8b06-3a903eff2f21 tempest-VolumesGetTest-67100045 None] Lock "cinder-5b3fea1f-c0ef-45d0-bad0-f892f20e153d-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-3e85e868-c9ea-454b-9049-111a732d967d-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Lock "cinder-3e85e868-c9ea-454b-9049-111a732d967d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Acquiring lock "cinder-quobyte-3e85e868-c9ea-454b-9049-111a732d967d" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-3e85e868-c9ea-454b-9049-111a732d967d" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:55 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ee659c-74bc-4d7b-b139-20372e5865d4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:55 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d Jul 24 15:45:55 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:56 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d" returned: 0 in 0.845s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:56 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d Jul 24 15:45:56 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:56 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3e85e868-c9ea-454b-9049-111a732d967d" returned: 0 in 0.792s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Lock "cinder-quobyte-3e85e868-c9ea-454b-9049-111a732d967d" released by "delete_volume" :: held 1.812s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:56 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Created reservations ['6c82945d-bc86-42e3-9165-12e5ddbe4207', '083a5a3f-5d19-4095-bec0-eb8de7b7b461', '94df1777-ac66-40db-b980-6369762ea413', 'b163f4c4-2c15-48c2-8f5a-f7f1e519058f'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:57 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:45:57 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:57 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.797s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:57 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Deleted volume successfully. Jul 24 15:45:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fb8daeb3-ecbd-4d7a-8e4b-091c4fff9d0a tempest-VolumesGetTest-67100045 None] Lock "cinder-3e85e868-c9ea-454b-9049-111a732d967d-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d0ebace-60ef-4692-83b9-8ff9221be11f tempest-VolumesActionsTest-1011356962 None] Acquiring lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" by "attach_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d0ebace-60ef-4692-83b9-8ff9221be11f tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" acquired by "attach_volume" :: waited 0.035s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2d0ebace-60ef-4692-83b9-8ff9221be11f tempest-VolumesActionsTest-1011356962 None] Attaching volume 5e0b666f-c5cf-4ea8-b813-532dd392dd2d to instance 2cb3c151-3ecd-4c03-b268-c8fdc1d40fe5 at mountpoint /dev/vdb on host None. Jul 24 15:46:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2d0ebace-60ef-4692-83b9-8ff9221be11f tempest-VolumesActionsTest-1011356962 None] Attach volume completed successfully. Jul 24 15:46:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2d0ebace-60ef-4692-83b9-8ff9221be11f tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" released by "attach_volume" :: held 0.194s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5cce017-8200-4095-a7e6-40f1b8ca7ef6 tempest-VolumesActionsTest-1011356962 None] Acquiring lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-detach_volume" by "detach_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5cce017-8200-4095-a7e6-40f1b8ca7ef6 tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a5cce017-8200-4095-a7e6-40f1b8ca7ef6 tempest-VolumesActionsTest-1011356962 None] Detaching volume 5e0b666f-c5cf-4ea8-b813-532dd392dd2d from instance 2cb3c151-3ecd-4c03-b268-c8fdc1d40fe5. Jul 24 15:46:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a5cce017-8200-4095-a7e6-40f1b8ca7ef6 tempest-VolumesActionsTest-1011356962 None] Detach volume completed successfully. Jul 24 15:46:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5cce017-8200-4095-a7e6-40f1b8ca7ef6 tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Flow 'volume_create_manager' (42b62619-3b7e-46d0-b650-a0231c82fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf7c436-681b-41f1-8c05-7fcdd8e77f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf7c436-681b-41f1-8c05-7fcdd8e77f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1403671327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3c3ee82cf544a3ba9c9c481e2c8f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:03Z,use_quota=True,user_id='69ed2e7384094a049e06bd57d5219d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd18017-7889-49a9-a3d6-c24259e23bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd18017-7889-49a9-a3d6-c24259e23bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4437eff7-ce36-46d6-b902-9396852169f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4437eff7-ce36-46d6-b902-9396852169f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e', 'volume_name': 'volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1be0acc-6354-4556-b80f-06a1c9d11960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1be0acc-6354-4556-b80f-06a1c9d11960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e2ae26-ffe1-4ee3-bc15-4b5bdab24153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Volume e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e', 'volume_size': 1} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1403671327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3c3ee82cf544a3ba9c9c481e2c8f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:03Z,use_quota=True,user_id='69ed2e7384094a049e06bd57d5219d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Creating volume e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:46:03 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:03 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e 1073741824 Jul 24 15:46:03 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Flow 'volume_create_manager' (5c15934b-997e-4ae0-936d-9b31f9d0116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d56a7c-82b7-4093-a5cc-986ba1ab719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d56a7c-82b7-4093-a5cc-986ba1ab719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1431305838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fa20a8-6c0d-43cd-9113-6f984a03b54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d901a276bc4fcca778dd4319508f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:03Z,use_quota=True,user_id='2e808014a46e4c989bed96dab5b7a934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee666194-da74-407c-a411-ba5d38b3c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee666194-da74-407c-a411-ba5d38b3c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7380b2d4-7adf-4673-a29e-7734329e0539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7380b2d4-7adf-4673-a29e-7734329e0539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fa20a8-6c0d-43cd-9113-6f984a03b54c', 'volume_name': 'volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1690d2e0-c72e-4384-9645-d9fde790fb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1690d2e0-c72e-4384-9645-d9fde790fb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a49e06-6f51-4c44-b23a-c76442a052c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:03 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Volume a4fa20a8-6c0d-43cd-9113-6f984a03b54c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c', 'volume_size': 1} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:03 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e 1073741824" returned: 0 in 0.650s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:03 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e Jul 24 15:46:03 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:04 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" returned: 0 in 0.320s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1431305838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fa20a8-6c0d-43cd-9113-6f984a03b54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d901a276bc4fcca778dd4319508f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:03Z,use_quota=True,user_id='2e808014a46e4c989bed96dab5b7a934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Creating volume a4fa20a8-6c0d-43cd-9113-6f984a03b54c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:46:04 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e2ae26-ffe1-4ee3-bc15-4b5bdab24153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abf073d-466c-40e4-9e8f-a8c66c59fe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:04 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c 1073741824 Jul 24 15:46:04 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:04 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Volume volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e (e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e): created successfully Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abf073d-466c-40e4-9e8f-a8c66c59fe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Flow 'volume_create_manager' (42b62619-3b7e-46d0-b650-a0231c82fb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:04 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-69a73755-c2c8-41c2-a422-55c94bd817fe tempest-VolumesSnapshotListTestJSON-267330799 None] Created volume successfully. Jul 24 15:46:04 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c 1073741824" returned: 0 in 0.528s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:04 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c Jul 24 15:46:04 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:05 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c" returned: 0 in 0.365s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a49e06-6f51-4c44-b23a-c76442a052c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d005622-339d-4161-9106-d8eb13897d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Creating offline snapshot 7b2c950d-ed93-437a-a4f0-379180a88282 of volume e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:46:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Volume volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c (a4fa20a8-6c0d-43cd-9113-6f984a03b54c): created successfully Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d005622-339d-4161-9106-d8eb13897d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Flow 'volume_create_manager' (5c15934b-997e-4ae0-936d-9b31f9d0116d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[64759a45-15fc-4984-aeb4-4e95b8aab6d8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-09c337f5-c198-4e6b-8d67-fa5671c82abf tempest-AttachVolumeTestJSON-197735795 None] Created volume successfully. Jul 24 15:46:05 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e Jul 24 15:46:05 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:05 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" returned: 0 in 0.410s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:05 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 1G Jul 24 15:46:05 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:06 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 1G" returned: 0 in 0.480s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:06 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 Jul 24 15:46:06 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:06 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282" returned: 0 in 0.351s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:06 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 is being set with open permissions: ugo+rw Jul 24 15:46:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:06 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 Jul 24 15:46:06 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:06 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282" returned: 0 in 0.307s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:06 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.info Jul 24 15:46:06 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:07 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.info" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:07 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.info is being set with open permissions: ugo+rw Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-73597019-b737-4387-a044-305a8550d042 req-08166546-0063-4fc5-8613-a3920914212c tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:07 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.info Jul 24 15:46:07 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:07 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.info" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-73597019-b737-4387-a044-305a8550d042 req-08166546-0063-4fc5-8613-a3920914212c tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.255s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-73597019-b737-4387-a044-305a8550d042 req-08166546-0063-4fc5-8613-a3920914212c tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.159s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b00b1-f580-41e2-acef-f2b4b184ca9e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:07 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f9ab4e07-001d-42db-9f46-06c20fa7556f tempest-VolumesSnapshotListTestJSON-267330799 None] Create snapshot completed successfully Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-73597019-b737-4387-a044-305a8550d042 req-08166546-0063-4fc5-8613-a3920914212c tempest-AttachVolumeTestJSON-197735795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17ceefb3-4d30-4a2d-b04c-0715772c4bb6', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:46:07 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-73597019-b737-4387-a044-305a8550d042 req-08166546-0063-4fc5-8613-a3920914212c tempest-AttachVolumeTestJSON-197735795 None] attachment_update completed successfully. Jul 24 15:46:07 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:46:07 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:07 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.400s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3169e2-1b0b-4e65-9391-0fb3a8940a38]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:08 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:46:08 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:08 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.420s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.1b7a5602-b849-48f2-9af8-49cfb90ecefap65p9u3l.img {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:08 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.1b7a5602-b849-48f2-9af8-49cfb90ecefap65p9u3l.img Jul 24 15:46:08 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Flow 'volume_create_manager' (e69b71b4-6119-40e2-acf0-3fcc6a4f1154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e5246c-bfdf-480e-998a-5e390410c4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e5246c-bfdf-480e-998a-5e390410c4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1476872646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143e387b-4452-443c-bdca-617ab014c8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d901a276bc4fcca778dd4319508f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:11Z,use_quota=True,user_id='2e808014a46e4c989bed96dab5b7a934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135c8925-9e3c-487a-b02c-95118646519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135c8925-9e3c-487a-b02c-95118646519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d565cd-9552-487d-bf73-3a4a58c5dbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d565cd-9552-487d-bf73-3a4a58c5dbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143e387b-4452-443c-bdca-617ab014c8ac', 'volume_name': 'volume-143e387b-4452-443c-bdca-617ab014c8ac', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240f7725-f2e6-4890-9f95-e1be7c6e5f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240f7725-f2e6-4890-9f95-e1be7c6e5f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b03cf3-bb8a-478d-9c0b-25364e45ae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:11 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Volume 143e387b-4452-443c-bdca-617ab014c8ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143e387b-4452-443c-bdca-617ab014c8ac', 'volume_size': 1} Jul 24 15:46:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:13 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.1b7a5602-b849-48f2-9af8-49cfb90ecefap65p9u3l.img" returned: 0 in 4.839s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:13 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b5fe3-8643-463e-b24c-9e151748b311]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:13 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:46:13 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:13 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.562s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:13 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.1b7a5602-b849-48f2-9af8-49cfb90ecefap65p9u3l.img {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:46:13 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Converted 1024.00 MB image at 211.45 MB/s Jul 24 15:46:13 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] 1b7a5602-b849-48f2-9af8-49cfb90ecefa was raw, no need to convert to raw {{(pid=88251) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 24 15:46:23 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=83,cinder:SELECT=72,cinder:DELETE=9,cinder:INSERT=25 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:46:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-f242af27-5f66-4124-a3d0-01d29ec7c415 req-e7d9bdb7-9384-45b3-8555-401a9f0505be tempest-AttachVolumeNegativeTest-553811594 None] Terminate volume connection completed successfully. Jul 24 15:46:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-f242af27-5f66-4124-a3d0-01d29ec7c415 req-e7d9bdb7-9384-45b3-8555-401a9f0505be tempest-AttachVolumeNegativeTest-553811594 None] Deleting attachment 7d954e0f-5f28-4542-98ae-7177854ca755. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:46:33 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=34,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=4 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:46:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:46:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:34 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:46:34 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:35 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.373s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 28 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.201s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Uploaded volume to glance image-id: 1b7a5602-b849-48f2-9af8-49cfb90ecefa. {{(pid=88251) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 27.063s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Creating offline snapshot 5a99c5d0-b918-4f4f-923c-06944c1612cb of volume e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:46:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1285ed5f-1d33-4a70-acdd-91f73fa551e3 tempest-VolumesActionsTest-1011356962 None] Copy volume to image completed successfully. Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8726949e-d459-459e-b076-97f93cc4446e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:35 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 Jul 24 15:46:35 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:36 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282" returned: 0 in 0.580s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:46:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:36 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb 1G Jul 24 15:46:36 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:37 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb 1G" returned: 0 in 0.835s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:37 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb Jul 24 15:46:37 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:37 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb" returned: 0 in 0.413s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:37 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb is being set with open permissions: ugo+rw Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:37 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb Jul 24 15:46:37 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:37 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb" returned: 0 in 0.271s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.405s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1476872646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143e387b-4452-443c-bdca-617ab014c8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d901a276bc4fcca778dd4319508f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:11Z,use_quota=True,user_id='2e808014a46e4c989bed96dab5b7a934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Creating volume 143e387b-4452-443c-bdca-617ab014c8ac {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:46:37 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:37 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac 1073741824 Jul 24 15:46:37 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:37 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f9774887-6102-4526-b0b4-d089ae2c3454 tempest-VolumesSnapshotListTestJSON-267330799 None] Create snapshot completed successfully Jul 24 15:46:38 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac 1073741824" returned: 0 in 0.518s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:38 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac Jul 24 15:46:38 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:38 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac" returned: 0 in 0.332s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.831s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b03cf3-bb8a-478d-9c0b-25364e45ae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143e387b-4452-443c-bdca-617ab014c8ac', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a5d7b0-5d4a-407c-8378-5528795e3123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a756d582-f58a-4574-a87b-16c419fb7934]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:38 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Volume volume-143e387b-4452-443c-bdca-617ab014c8ac (143e387b-4452-443c-bdca-617ab014c8ac): created successfully Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a5d7b0-5d4a-407c-8378-5528795e3123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Flow 'volume_create_manager' (e69b71b4-6119-40e2-acf0-3fcc6a4f1154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:38 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c2e7e51e-bcce-4068-9a55-d9e4ed9d4550 tempest-AttachVolumeTestJSON-197735795 None] Created volume successfully. Jul 24 15:46:38 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:46:38 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:39 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.401s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1700726-5684-4ca4-8ad5-ed7c9ff2aaed]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:39 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:46:39 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:39 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.571s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:39 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img Jul 24 15:46:39 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-16e7f122-3b86-4493-81ac-b360f5130dc3 req-74e2bbe6-b335-4ba3-8572-6f58fb47eb8b tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:45 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img" returned: 0 in 5.959s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:45 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ea2a67-f910-4ab9-a958-dac0442c28d5]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:45 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:46:45 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:46 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.606s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:46 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:46:46 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Converted 1024.00 MB image at 171.82 MB/s Jul 24 15:46:46 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] e4781567-04fe-4d0f-972c-659ce14125a3 was raw, converting to qcow2 {{(pid=88251) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 24 15:46:46 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4177c16a-36f2-487b-a06a-052a726a0010]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:46 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img Jul 24 15:46:46 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:46 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img" returned: 0 in 0.337s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:46 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img Jul 24 15:46:46 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:47 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img" returned: 1 in 0.342s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:46:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img /opt/stack/data/cinder/conversion/vol_upload_lix9occ4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:47 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img /opt/stack/data/cinder/conversion/vol_upload_lix9occ4 Jul 24 15:46:47 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:47 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img /opt/stack/data/cinder/conversion/vol_upload_lix9occ4" returned: 0 in 0.280s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:47 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Image conversion details: src /opt/stack/data/cinder/conversion/5e0b666f-c5cf-4ea8-b813-532dd392dd2d.temp_image.e4781567-04fe-4d0f-972c-659ce14125a39wmsjxye.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_lix9occ4 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:46:47 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 24 15:46:47 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a235c-a5f9-49a0-98a2-03632f5b7c4d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lix9occ4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:47 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lix9occ4 Jul 24 15:46:47 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:47 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lix9occ4" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.274s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Uploaded volume to glance image-id: e4781567-04fe-4d0f-972c-659ce14125a3. {{(pid=88251) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.852s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Creating offline snapshot b73746de-0b9a-4fce-be74-5470fc3f6891 of volume e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[07185843-20a5-42b7-98d1-a4ed373e8ad7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:49 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb Jul 24 15:46:49 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-17042df9-9765-41c4-85cc-43688dd7d786 tempest-VolumesActionsTest-1011356962 None] Copy volume to image completed successfully. Jul 24 15:46:49 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb" returned: 0 in 0.474s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:46:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:49 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 1G Jul 24 15:46:49 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:50 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 1G" returned: 0 in 0.477s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:50 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 Jul 24 15:46:50 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Acquiring lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:50 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891" returned: 0 in 0.376s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:50 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 is being set with open permissions: ugo+rw Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Acquiring lock "cinder-quobyte-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Lock "cinder-quobyte-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:50 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 Jul 24 15:46:50 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fefdfbb-625d-4301-b23b-89cd00096cba]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:50 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:46:50 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:50 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.799s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-16e7f122-3b86-4493-81ac-b360f5130dc3 req-74e2bbe6-b335-4ba3-8572-6f58fb47eb8b tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.850s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-16e7f122-3b86-4493-81ac-b360f5130dc3 req-74e2bbe6-b335-4ba3-8572-6f58fb47eb8b tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9b42b650-68f2-43ae-8a0e-ea7fb28259c8 tempest-VolumesSnapshotListTestJSON-267330799 None] Create snapshot completed successfully Jul 24 15:46:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-16e7f122-3b86-4493-81ac-b360f5130dc3 req-74e2bbe6-b335-4ba3-8572-6f58fb47eb8b tempest-AttachVolumeTestJSON-197735795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-143e387b-4452-443c-bdca-617ab014c8ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad496165-8293-416a-b488-f6f877e1b799', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:46:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-16e7f122-3b86-4493-81ac-b360f5130dc3 req-74e2bbe6-b335-4ba3-8572-6f58fb47eb8b tempest-AttachVolumeTestJSON-197735795 None] attachment_update completed successfully. Jul 24 15:46:51 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.461s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:51 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d Jul 24 15:46:51 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:51 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" returned: 0 in 0.262s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Lock "cinder-quobyte-5e0b666f-c5cf-4ea8-b813-532dd392dd2d" released by "delete_volume" :: held 0.761s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Created reservations ['4fe2d10e-41d3-495b-9e5b-320e316ae4e4', 'f7e267c1-6f88-4c13-a57a-21e6d02244a6', '7d3e4386-2ee8-4340-b71e-dba01cd34337', '1a77fbc2-718f-4b38-8be7-95b3f71ee727'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:51 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:46:51 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:51 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.318s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:46:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Deleted volume successfully. Jul 24 15:46:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b4315b5d-1d2e-4806-9ba5-2d8da83dcc2d tempest-VolumesActionsTest-1011356962 None] Lock "cinder-5e0b666f-c5cf-4ea8-b813-532dd392dd2d-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-b73746de-0b9a-4fce-be74-5470fc3f6891-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-b73746de-0b9a-4fce-be74-5470fc3f6891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-quobyte-b73746de-0b9a-4fce-be74-5470fc3f6891" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-b73746de-0b9a-4fce-be74-5470fc3f6891" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Deleting offline snapshot b73746de-0b9a-4fce-be74-5470fc3f6891 of volume e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] snapshot_file for this snap is: volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e93c0-9672-45f1-9bd2-e567da6a50c0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:53 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 Jul 24 15:46:53 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-fb594a94-efd2-4425-a6fa-b165be86d1f3 req-31c1e303-fa6c-48e9-b02a-28582125a053 tempest-AttachVolumeTestJSON-197735795 None] Terminate volume connection completed successfully. Jul 24 15:46:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-fb594a94-efd2-4425-a6fa-b165be86d1f3 req-31c1e303-fa6c-48e9-b02a-28582125a053 tempest-AttachVolumeTestJSON-197735795 None] Deleting attachment 17ceefb3-4d30-4a2d-b04c-0715772c4bb6. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:46:53 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891" returned: 0 in 0.452s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:46:53 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4628c606-4afc-4f78-b0e4-13a7124c854b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:53 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb Jul 24 15:46:53 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:53 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb" returned: 0 in 0.408s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:46:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:53 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 Jul 24 15:46:53 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:54 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891" returned: 0 in 0.553s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:54 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891 Jul 24 15:46:54 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-9ac675e8-b754-4d7c-9566-6bfe8dac32a4 req-bb974e9c-657d-44e7-a853-6800d9df6243 tempest-AttachVolumeTestJSON-197735795 None] Terminate volume connection completed successfully. Jul 24 15:46:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-9ac675e8-b754-4d7c-9566-6bfe8dac32a4 req-bb974e9c-657d-44e7-a853-6800d9df6243 tempest-AttachVolumeTestJSON-197735795 None] Deleting attachment ad496165-8293-416a-b488-f6f877e1b799. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:46:54 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.b73746de-0b9a-4fce-be74-5470fc3f6891" returned: 0 in 0.276s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-b73746de-0b9a-4fce-be74-5470fc3f6891" released by "_delete_snapshot" :: held 1.844s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" released by "delete_snapshot" :: held 1.882s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:54 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Created reservations ['3d06f222-f466-4a3e-af67-da2e4a7c82f3', '071b165e-58b6-4ad9-a9fa-0010dfb5ddb2', 'bc266646-4392-400e-882d-be646f582bae', 'ce7434ce-7945-42e5-9b73-cbc29b8b1035'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Delete snapshot completed successfully. Jul 24 15:46:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf67d1e7-52b8-4d7d-a983-a40333ecf37f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-b73746de-0b9a-4fce-be74-5470fc3f6891-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-5a99c5d0-b918-4f4f-923c-06944c1612cb-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-5a99c5d0-b918-4f4f-923c-06944c1612cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-quobyte-5a99c5d0-b918-4f4f-923c-06944c1612cb" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-5a99c5d0-b918-4f4f-923c-06944c1612cb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Deleting offline snapshot 5a99c5d0-b918-4f4f-923c-06944c1612cb of volume e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] snapshot_file for this snap is: volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ca6b7-e19c-4052-a25c-4da6db1122c5]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:56 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb Jul 24 15:46:56 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:56 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb" returned: 0 in 0.557s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[125ff7a6-7778-4a7d-a8c4-1ba3e50d28be]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:56 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 Jul 24 15:46:56 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:57 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282" returned: 0 in 0.446s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:46:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:57 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb Jul 24 15:46:57 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:57 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb" returned: 0 in 0.530s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:57 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb Jul 24 15:46:57 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:57 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.5a99c5d0-b918-4f4f-923c-06944c1612cb" returned: 0 in 0.286s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-5a99c5d0-b918-4f4f-923c-06944c1612cb" released by "_delete_snapshot" :: held 1.990s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" released by "delete_snapshot" :: held 2.016s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:58 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Created reservations ['8b132f23-4ab3-43c6-8acc-103876da04f8', 'fc407544-b307-46e0-8b89-b80b248d66fc', '85927758-5e4b-455d-a0c3-be1ecf6041cc', '2398c715-e948-423d-8315-754b1ff85608'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Delete snapshot completed successfully. Jul 24 15:46:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f29f3ada-8f13-45f1-b933-53ecc172e65f tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-5a99c5d0-b918-4f4f-923c-06944c1612cb-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:58 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:46:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Flow 'volume_create_manager' (a085f825-1d28-4d2a-9036-76819ce46cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465b6d58-e2ee-4fe5-94e8-55738f060d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465b6d58-e2ee-4fe5-94e8-55738f060d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-887549062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2860df75-ef37-41f4-952b-ca8dbc90a944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ad78e81c934dc999eba20ab589a946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:59Z,use_quota=True,user_id='fb67a4ce064245819fe5869135d632d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9a62e1-cd8d-4c0e-9949-5dccae93309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9a62e1-cd8d-4c0e-9949-5dccae93309d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ecf5ba-8636-4f6b-bb4d-dcbfe61f9791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ecf5ba-8636-4f6b-bb4d-dcbfe61f9791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2860df75-ef37-41f4-952b-ca8dbc90a944', 'volume_name': 'volume-2860df75-ef37-41f4-952b-ca8dbc90a944', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac2d553-845d-4a39-85c0-2403e2614674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac2d553-845d-4a39-85c0-2403e2614674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19263c33-f199-4602-8103-7bb148e67849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:59 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Volume 2860df75-ef37-41f4-952b-ca8dbc90a944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2860df75-ef37-41f4-952b-ca8dbc90a944', 'volume_size': 1} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-887549062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2860df75-ef37-41f4-952b-ca8dbc90a944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ad78e81c934dc999eba20ab589a946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:59Z,use_quota=True,user_id='fb67a4ce064245819fe5869135d632d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Creating volume 2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:46:59 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:59 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 1073741824 Jul 24 15:46:59 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-7b2c950d-ed93-437a-a4f0-379180a88282-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-7b2c950d-ed93-437a-a4f0-379180a88282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-quobyte-7b2c950d-ed93-437a-a4f0-379180a88282" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-7b2c950d-ed93-437a-a4f0-379180a88282" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Deleting offline snapshot 7b2c950d-ed93-437a-a4f0-379180a88282 of volume e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] snapshot_file for this snap is: volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6406fd9-b4b8-4700-8df2-6f5f8493cb8d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:59 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 Jul 24 15:46:59 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:59 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 1073741824" returned: 0 in 0.485s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:59 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 Jul 24 15:46:59 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:59 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282" returned: 0 in 0.384s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ce7478-91f7-49bb-9bbd-7bb7fc1d8ed5]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:59 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944" returned: 0 in 0.301s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19263c33-f199-4602-8103-7bb148e67849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2860df75-ef37-41f4-952b-ca8dbc90a944', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea87d5e-cdaf-4e28-81de-02ba41bb0d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:59 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Volume volume-2860df75-ef37-41f4-952b-ca8dbc90a944 (2860df75-ef37-41f4-952b-ca8dbc90a944): created successfully Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea87d5e-cdaf-4e28-81de-02ba41bb0d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Flow 'volume_create_manager' (a085f825-1d28-4d2a-9036-76819ce46cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:59 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e Jul 24 15:46:59 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:59 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2d942711-59ea-48bc-8509-d7ee18e98372 tempest-VolumesCloneTest-114306826 None] Created volume successfully. Jul 24 15:47:00 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" returned: 0 in 0.456s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:00 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 Jul 24 15:47:00 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:00 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282" returned: 0 in 0.439s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:00 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282 Jul 24 15:47:00 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "cinder-143e387b-4452-443c-bdca-617ab014c8ac-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-143e387b-4452-443c-bdca-617ab014c8ac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "cinder-quobyte-143e387b-4452-443c-bdca-617ab014c8ac" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-quobyte-143e387b-4452-443c-bdca-617ab014c8ac" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:00 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e.7b2c950d-ed93-437a-a4f0-379180a88282" returned: 0 in 0.315s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f23c48-0694-4d1d-919b-383a8a7624b1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-7b2c950d-ed93-437a-a4f0-379180a88282" released by "_delete_snapshot" :: held 1.732s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" released by "delete_snapshot" :: held 1.758s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Created reservations ['f7e12cb1-8664-4ee0-af1b-ae80dc10a867', '3c69a615-821f-4122-9184-af02a9566d6e', '1ddd7a9a-4998-4b43-9a64-da30dcab9086', '59fefd27-7f5e-4ebe-8768-07604e84e110'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:01 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac Jul 24 15:47:01 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Delete snapshot completed successfully. Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-727aef34-b6a5-46b0-8eb2-896c625b158a tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-7b2c950d-ed93-437a-a4f0-379180a88282-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:01 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac" returned: 0 in 0.470s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:01 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac Jul 24 15:47:01 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6538e2-54e6-48f8-af35-2b15b31dd720]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:01 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e Jul 24 15:47:01 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:01 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-143e387b-4452-443c-bdca-617ab014c8ac" returned: 0 in 0.370s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-quobyte-143e387b-4452-443c-bdca-617ab014c8ac" released by "delete_volume" :: held 0.915s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Flow 'volume_create_manager' (eb53c21a-4d04-42e3-88a2-02755cee380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40603818-e14c-4dad-ae1f-192bb6b71e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40603818-e14c-4dad-ae1f-192bb6b71e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-863930387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66c376d-2d21-4ddf-9c0b-07726b6655d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ad78e81c934dc999eba20ab589a946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2860df75-ef37-41f4-952b-ca8dbc90a944,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:02Z,use_quota=True,user_id='fb67a4ce064245819fe5869135d632d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b83a04-0b27-4544-86fa-8c9162c3c00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b83a04-0b27-4544-86fa-8c9162c3c00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa871d9c-4017-4d78-abe3-ac2af69d2722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa871d9c-4017-4d78-abe3-ac2af69d2722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd66c376d-2d21-4ddf-9c0b-07726b6655d4', 'volume_name': 'volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4', 'volume_size': 2, 'source_volid': '2860df75-ef37-41f4-952b-ca8dbc90a944', 'source_volstatus': 'available'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5195a06c-dd3c-469c-af21-3b67aaf506bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5195a06c-dd3c-469c-af21-3b67aaf506bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d657de-6fb3-4d05-8fe9-a75049feadd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:02 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Volume d66c376d-2d21-4ddf-9c0b-07726b6655d4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4', 'volume_size': 2, 'source_volid': '2860df75-ef37-41f4-952b-ca8dbc90a944', 'source_volstatus': 'available'} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:02 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Cloning volume 2860df75-ef37-41f4-952b-ca8dbc90a944 to volume d66c376d-2d21-4ddf-9c0b-07726b6655d4 Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Created reservations ['6a23fa4d-3172-407a-972f-284b9fa2a009', 'ce302f9d-4c2e-4eb3-b7bd-fffe9e006369', '27efbd09-9487-49bf-8bf7-77f81506015c', '9fcc1de6-a907-4475-9559-0d31ee03d4c8'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Creating offline snapshot bc3f03a9-2d3d-4e82-bb74-f175abe380ec of volume 2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:47:02 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a206268-2f94-4652-9516-e0b3c2452534]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" returned: 0 in 0.421s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:02 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e Jul 24 15:47:02 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:02 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:02 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:02 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 Jul 24 15:47:02 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:02 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" returned: 0 in 0.288s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:02 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.247s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-quobyte-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e" released by "delete_volume" :: held 0.799s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:02 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Deleted volume successfully. Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86b3aad4-8c02-4a47-9897-3bf87ed2b1e7 tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-143e387b-4452-443c-bdca-617ab014c8ac-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:02 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944" returned: 0 in 0.386s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Created reservations ['147d5be2-9d48-42c4-af9e-acb890615804', '115ce1d1-19a1-4c1d-8432-e4dfb987568f', '7f215c8e-204f-42cf-95f2-ff4535c9c2b1', '3444e69b-aa68-4972-b80b-a204650b657a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:02 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec 1G Jul 24 15:47:02 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:02 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:02 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:02 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.285s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:02 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Deleted volume successfully. Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc503ea3-4f03-4686-bc86-47c3a73cb58d tempest-VolumesSnapshotListTestJSON-267330799 None] Lock "cinder-e9b39ae0-b6a1-4cbc-9e75-3715ff2d3f3e-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:02 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec 1G" returned: 0 in 0.469s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2860df75-ef37-41f4-952b-ca8dbc90a944 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:03 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2860df75-ef37-41f4-952b-ca8dbc90a944 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec Jul 24 15:47:03 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "cinder-a4fa20a8-6c0d-43cd-9113-6f984a03b54c-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-a4fa20a8-6c0d-43cd-9113-6f984a03b54c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "cinder-quobyte-a4fa20a8-6c0d-43cd-9113-6f984a03b54c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-quobyte-a4fa20a8-6c0d-43cd-9113-6f984a03b54c" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5609bee5-9135-4294-93a9-6ade7a0e0bb7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:03 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2860df75-ef37-41f4-952b-ca8dbc90a944 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec" returned: 0 in 0.331s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:03 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec is being set with open permissions: ugo+rw Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:03 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec Jul 24 15:47:03 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:03 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c Jul 24 15:47:03 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:03 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec" returned: 0 in 0.279s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:03 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.info Jul 24 15:47:03 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:03 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c" returned: 0 in 0.465s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:03 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c Jul 24 15:47:03 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:03 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.info" returned: 0 in 0.321s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:03 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.info is being set with open permissions: ugo+rw Jul 24 15:47:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:03 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.info Jul 24 15:47:03 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:04 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a4fa20a8-6c0d-43cd-9113-6f984a03b54c" returned: 0 in 0.293s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-quobyte-a4fa20a8-6c0d-43cd-9113-6f984a03b54c" released by "delete_volume" :: held 0.800s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Created reservations ['f83ad72d-d56d-45a1-9355-b214d85316f6', 'a43c8cf9-5def-4681-b7c6-627fa647de8a', '7f20fe88-6094-4607-b397-31b88f737cd8', '9f0c27f8-3c3c-48ff-b215-1e1a4d902e08'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:04 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:04 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:04 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.info" returned: 0 in 0.287s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Acquiring lock "cinder-quobyte-d66c376d-2d21-4ddf-9c0b-07726b6655d4" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Lock "cinder-quobyte-d66c376d-2d21-4ddf-9c0b-07726b6655d4" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] snapshot: bc3f03a9-2d3d-4e82-bb74-f175abe380ec, volume: d66c376d-2d21-4ddf-9c0b-07726b6655d4, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc943dc-733d-4c6a-9179-3d0d3a5c54da]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:04 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:04 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec Jul 24 15:47:04 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "cinder-32afe506-3082-4840-8377-5031e6ec532d-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.313s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:04 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Deleted volume successfully. Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-32afe506-3082-4840-8377-5031e6ec532d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd3170bd-94a4-4e56-97e8-b1ebafac3128 tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-a4fa20a8-6c0d-43cd-9113-6f984a03b54c-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "cinder-quobyte-32afe506-3082-4840-8377-5031e6ec532d" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-quobyte-32afe506-3082-4840-8377-5031e6ec532d" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c9c46-e56e-4906-818a-9e4498ae7f62]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:04 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d Jul 24 15:47:04 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:04 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec" returned: 0 in 0.428s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2860df75-ef37-41f4-952b-ca8dbc90a944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a3031c-a2f6-408b-8e13-588029862a91]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:04 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 Jul 24 15:47:04 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:05 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d" returned: 0 in 0.419s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:05 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d Jul 24 15:47:05 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:05 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944" returned: 0 in 0.454s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:05 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 Jul 24 15:47:05 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:05 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-32afe506-3082-4840-8377-5031e6ec532d" returned: 0 in 0.293s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-quobyte-32afe506-3082-4840-8377-5031e6ec532d" released by "delete_volume" :: held 0.762s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Created reservations ['cb28f1b1-bf5b-4ac5-8ed1-29cfed97ef57', '7d0a3753-270b-4d79-9bdb-286a77974305', '9ce2ceb3-6679-45e0-86cb-baca6560a8a6', 'f6a5d344-4e51-450d-aef7-975c16553a7a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:05 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:05 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Flow 'volume_create_manager' (d644ae9f-c6d7-4677-8b8b-b572f48c77f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d03c64-490d-449c-a734-68803d01c688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d03c64-490d-449c-a734-68803d01c688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-648616590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbf808d-8819-41bf-8c16-0dbabc9fff70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5adfb6121124fe7a92f2181ad26f5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:06Z,use_quota=True,user_id='ec238608b2284dd3ad837cb0f38feeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fb88dd-bd02-4867-a694-ddcf131aba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fb88dd-bd02-4867-a694-ddcf131aba3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fa30f1-0483-4d28-98a7-811a4915158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fa30f1-0483-4d28-98a7-811a4915158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cbf808d-8819-41bf-8c16-0dbabc9fff70', 'volume_name': 'volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3340d03b-7f8d-4dca-894e-2fcd2ef88835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3340d03b-7f8d-4dca-894e-2fcd2ef88835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:06 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3193eb9d-881b-4cb6-ab6f-6f206a327bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:06 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Volume 1cbf808d-8819-41bf-8c16-0dbabc9fff70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70', 'volume_size': 1} Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.449s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Deleted volume successfully. Jul 24 15:47:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-99f7421b-a49f-490d-bce4-41d1d12df0dd tempest-AttachVolumeTestJSON-197735795 None] Lock "cinder-32afe506-3082-4840-8377-5031e6ec532d-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Flow 'volume_create_manager' (2b903ee1-1237-4053-b2e7-03112557acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb44ec73-e8e5-409d-84d4-283780f8fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb44ec73-e8e5-409d-84d4-283780f8fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1897945269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbeaf17-2383-4aa1-b6a7-ca827b4a601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a6f390dda949bbb8615ea9b81fb3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:07Z,use_quota=True,user_id='7d4883d9827e4691a40aa352ef3a5696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135e10fc-fffc-4e54-a821-59f4551cb8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135e10fc-fffc-4e54-a821-59f4551cb8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b10338d-c3f5-47e6-b78f-fd37bedc67f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b10338d-c3f5-47e6-b78f-fd37bedc67f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbeaf17-2383-4aa1-b6a7-ca827b4a601e', 'volume_name': 'volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e', 'volume_size': 2}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d4967-eb25-4c9c-a24a-e2923ccfb68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d4967-eb25-4c9c-a24a-e2923ccfb68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204e0a46-cfa8-4545-a77f-07ed4a09d61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:07 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Volume 2cbeaf17-2383-4aa1-b6a7-ca827b4a601e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e', 'volume_size': 2} Jul 24 15:47:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:10 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4" returned: 0 in 5.346s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32d5806-5094-4262-ac2c-2fd7106086f7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:10 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 Jul 24 15:47:10 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:11 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944" returned: 0 in 0.608s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:47:11 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Converted 1024.00 MB image at 191.52 MB/s Jul 24 15:47:11 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 is being set with open permissions: ugo+rw Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:11 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 Jul 24 15:47:11 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:11 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4" returned: 0 in 0.280s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Lock "cinder-quobyte-d66c376d-2d21-4ddf-9c0b-07726b6655d4" released by "_copy_volume_from_snapshot" :: held 7.238s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Acquiring lock "cinder-quobyte-bc3f03a9-2d3d-4e82-bb74-f175abe380ec" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Lock "cinder-quobyte-bc3f03a9-2d3d-4e82-bb74-f175abe380ec" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Deleting offline snapshot bc3f03a9-2d3d-4e82-bb74-f175abe380ec of volume 2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] snapshot_file for this snap is: volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf12a6f-a845-4e70-b7b0-e266019f039a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:11 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec Jul 24 15:47:11 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:12 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec" returned: 0 in 0.387s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2860df75-ef37-41f4-952b-ca8dbc90a944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:47:12 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed57b182-5600-429e-8e41-9c576521870c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:12 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 Jul 24 15:47:12 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:12 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944" returned: 0 in 0.426s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:12 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec Jul 24 15:47:12 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:12 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec" returned: 0 in 0.355s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:12 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec Jul 24 15:47:12 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:13 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944.bc3f03a9-2d3d-4e82-bb74-f175abe380ec" returned: 0 in 0.286s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Lock "cinder-quobyte-bc3f03a9-2d3d-4e82-bb74-f175abe380ec" released by "_delete_snapshot" :: held 1.575s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.162s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.135s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-648616590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbf808d-8819-41bf-8c16-0dbabc9fff70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5adfb6121124fe7a92f2181ad26f5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:06Z,use_quota=True,user_id='ec238608b2284dd3ad837cb0f38feeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Creating volume 1cbf808d-8819-41bf-8c16-0dbabc9fff70 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:13 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d657de-6fb3-4d05-8fe9-a75049feadd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4', 'volume_size': 2, 'source_volid': '2860df75-ef37-41f4-952b-ca8dbc90a944', 'source_volstatus': 'available'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:13 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 1073741824 Jul 24 15:47:13 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd63d8d6-47c8-4bf8-8c12-dd5204f6ddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:13 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Volume volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 (d66c376d-2d21-4ddf-9c0b-07726b6655d4): created successfully Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd63d8d6-47c8-4bf8-8c12-dd5204f6ddb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Flow 'volume_create_manager' (eb53c21a-4d04-42e3-88a2-02755cee380e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:13 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-4e47ca5b-6391-4caa-9408-9427464f35ec tempest-VolumesCloneTest-114306826 None] Created volume successfully. Jul 24 15:47:13 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 1073741824" returned: 0 in 0.496s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:13 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 Jul 24 15:47:13 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:14 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70" returned: 0 in 0.276s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.542s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1897945269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbeaf17-2383-4aa1-b6a7-ca827b4a601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a6f390dda949bbb8615ea9b81fb3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:07Z,use_quota=True,user_id='7d4883d9827e4691a40aa352ef3a5696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Creating volume 2cbeaf17-2383-4aa1-b6a7-ca827b4a601e {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:14 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e 2147483648 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3193eb9d-881b-4cb6-ab6f-6f206a327bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:14 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e 2147483648 Jul 24 15:47:14 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f94ee5-b91a-4fe3-ade3-93275a7976c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Acquiring lock "cinder-d66c376d-2d21-4ddf-9c0b-07726b6655d4-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Volume volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 (1cbf808d-8819-41bf-8c16-0dbabc9fff70): created successfully Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f94ee5-b91a-4fe3-ade3-93275a7976c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Flow 'volume_create_manager' (d644ae9f-c6d7-4677-8b8b-b572f48c77f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Lock "cinder-d66c376d-2d21-4ddf-9c0b-07726b6655d4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-95ba5f24-7a3a-48ff-9052-703b1bd518ec tempest-AttachVolumeNegativeTest-553811594 None] Created volume successfully. Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Acquiring lock "cinder-quobyte-d66c376d-2d21-4ddf-9c0b-07726b6655d4" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Lock "cinder-quobyte-d66c376d-2d21-4ddf-9c0b-07726b6655d4" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a58409-8a4c-4705-8300-c718697a442d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:14 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 Jul 24 15:47:14 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:14 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e 2147483648" returned: 0 in 0.650s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:14 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4" returned: 0 in 0.466s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:14 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4 Jul 24 15:47:14 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:14 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e Jul 24 15:47:14 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:15 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d66c376d-2d21-4ddf-9c0b-07726b6655d4" returned: 0 in 0.294s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Lock "cinder-quobyte-d66c376d-2d21-4ddf-9c0b-07726b6655d4" released by "delete_volume" :: held 0.810s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Created reservations ['e322ad4c-f61e-4cc4-9421-de9ac4ce451b', '6d156973-73ad-499b-83a0-09da89eb5842', '53fbe8d6-e793-42f8-b90e-df5e564003e9', '292308ad-1700-4b69-91c4-d1dceb552034'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:15 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" returned: 0 in 0.412s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204e0a46-cfa8-4545-a77f-07ed4a09d61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e', 'volume_size': 2}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63bd335-b9bf-47a5-81df-d6cd7b8e1170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:15 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:15 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:15 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Volume volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e (2cbeaf17-2383-4aa1-b6a7-ca827b4a601e): created successfully Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63bd335-b9bf-47a5-81df-d6cd7b8e1170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Flow 'volume_create_manager' (2b903ee1-1237-4053-b2e7-03112557acaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bff25760-3ee8-470b-9175-298fe03712ad tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Created volume successfully. Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Acquiring lock "cinder-2860df75-ef37-41f4-952b-ca8dbc90a944-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Lock "cinder-2860df75-ef37-41f4-952b-ca8dbc90a944-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Acquiring lock "cinder-quobyte-2860df75-ef37-41f4-952b-ca8dbc90a944" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Lock "cinder-quobyte-2860df75-ef37-41f4-952b-ca8dbc90a944" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[307f05a3-1127-4c28-af97-6a25b2a9a398]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:15 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.437s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Deleted volume successfully. Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-805dc95d-c159-4d69-bfb6-96ef44e87f3e tempest-VolumesCloneTest-114306826 None] Lock "cinder-d66c376d-2d21-4ddf-9c0b-07726b6655d4-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:15 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 Jul 24 15:47:15 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4dbf8110-1f7a-4534-8db1-9498a74fe95f req-76f82d62-3378-475c-a505-e1b142f16268 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4dbf8110-1f7a-4534-8db1-9498a74fe95f req-76f82d62-3378-475c-a505-e1b142f16268 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4dbf8110-1f7a-4534-8db1-9498a74fe95f req-76f82d62-3378-475c-a505-e1b142f16268 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4dbf8110-1f7a-4534-8db1-9498a74fe95f req-76f82d62-3378-475c-a505-e1b142f16268 tempest-AttachVolumeNegativeTest-553811594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4da890bd-ef89-4bb4-8eb7-5085a482e02a', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:47:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-4dbf8110-1f7a-4534-8db1-9498a74fe95f req-76f82d62-3378-475c-a505-e1b142f16268 tempest-AttachVolumeNegativeTest-553811594 None] attachment_update completed successfully. Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Flow 'volume_create_manager' (1eef0757-5cbb-4b3e-9c41-16d321e71c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc2a1c0-7638-4a3b-95a6-7747f7c88c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc2a1c0-7638-4a3b-95a6-7747f7c88c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1510727669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de4c17f-3d8d-4e96-aac9-7ff1af8f865e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8d0b855e954d4f8cba5205911392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:16Z,use_quota=True,user_id='8a83431f897c40fca63bc08eaaafffda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad784c5e-983c-486e-8f98-25ff852c93a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad784c5e-983c-486e-8f98-25ff852c93a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61251cc-4b7b-40f7-9694-a5c7b3315afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61251cc-4b7b-40f7-9694-a5c7b3315afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de4c17f-3d8d-4e96-aac9-7ff1af8f865e', 'volume_name': 'volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eeb141-75be-436e-920b-7474055fe99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eeb141-75be-436e-920b-7474055fe99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149bdeb5-f078-4f57-bdf1-b9ec1dbabb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:16 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Volume 1de4c17f-3d8d-4e96-aac9-7ff1af8f865e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e', 'volume_size': 1} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1510727669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de4c17f-3d8d-4e96-aac9-7ff1af8f865e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8d0b855e954d4f8cba5205911392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:16Z,use_quota=True,user_id='8a83431f897c40fca63bc08eaaafffda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Creating volume 1de4c17f-3d8d-4e96-aac9-7ff1af8f865e {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:16 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:16 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944" returned: 0 in 0.558s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:16 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e 1073741824 Jul 24 15:47:16 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:16 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944 Jul 24 15:47:16 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:16 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2860df75-ef37-41f4-952b-ca8dbc90a944" returned: 0 in 0.320s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Lock "cinder-quobyte-2860df75-ef37-41f4-952b-ca8dbc90a944" released by "delete_volume" :: held 0.972s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Created reservations ['a9d6c23b-e7db-4cfd-a4c1-18a3cd1ae127', 'f4abada4-41ef-4126-b2b4-b46a68d4741f', '41f872ce-0c08-436d-8f93-b4c3d65f7cdd', 'de1104de-8b2c-4fe9-ad2a-fa81b39af339'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:16 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:16 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:16 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e 1073741824" returned: 0 in 0.671s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:16 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e Jul 24 15:47:16 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:17 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.311s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:17 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Deleted volume successfully. Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-86be37c0-c983-4970-86e6-c6b512338d4b tempest-VolumesCloneTest-114306826 None] Lock "cinder-2860df75-ef37-41f4-952b-ca8dbc90a944-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:17 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" returned: 0 in 0.283s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.806s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149bdeb5-f078-4f57-bdf1-b9ec1dbabb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b370f8-46f5-4bdd-9f7c-8cb17fde3c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Creating offline snapshot 5734e45f-13fd-4be6-b434-7943e20bbd82 of volume 2cbeaf17-2383-4aa1-b6a7-ca827b4a601e {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:47:17 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Volume volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e (1de4c17f-3d8d-4e96-aac9-7ff1af8f865e): created successfully Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b370f8-46f5-4bdd-9f7c-8cb17fde3c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Flow 'volume_create_manager' (1eef0757-5cbb-4b3e-9c41-16d321e71c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91c389d-875a-47ef-ac85-0cca90a08bd3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:17 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-4fd2df8b-61b5-4028-886c-403282153e93 req-15ef2436-0624-48b8-83a4-b60707449d09 tempest-VolumesSnapshotsTestJSON-570469410 None] Created volume successfully. Jul 24 15:47:17 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e Jul 24 15:47:17 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:17 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 2G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:17 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 2G Jul 24 15:47:17 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:18 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 2G" returned: 0 in 0.537s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:18 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 Jul 24 15:47:18 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:18 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82" returned: 0 in 0.468s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:18 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 is being set with open permissions: ugo+rw Jul 24 15:47:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:18 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 Jul 24 15:47:18 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-5e1fcff1-098b-4f2d-8cc9-75d21bd8c53c req-072f9dde-fe0a-4a8f-a360-34eb40bf48e2 tempest-AttachVolumeNegativeTest-553811594 None] Terminate volume connection completed successfully. Jul 24 15:47:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-5e1fcff1-098b-4f2d-8cc9-75d21bd8c53c req-072f9dde-fe0a-4a8f-a360-34eb40bf48e2 tempest-AttachVolumeNegativeTest-553811594 None] Deleting attachment 4da890bd-ef89-4bb4-8eb7-5085a482e02a. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:47:19 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82" returned: 0 in 0.546s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:19 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.info Jul 24 15:47:19 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:19 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.info" returned: 0 in 0.358s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:19 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.info is being set with open permissions: ugo+rw Jul 24 15:47:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:19 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.info Jul 24 15:47:19 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:19 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.info" returned: 0 in 0.323s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.108s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Creating offline snapshot 028f6c19-352d-4436-ba55-65c525a0c728 of volume 1de4c17f-3d8d-4e96-aac9-7ff1af8f865e {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:47:19 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5c2d50b8-7585-4be2-9c77-0e79db37bd57 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Create snapshot completed successfully Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[052c58dd-df91-43ea-a2cb-66c04ebe010c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:20 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e Jul 24 15:47:20 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:20 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" returned: 0 in 0.723s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:20 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 1G Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "cinder-5734e45f-13fd-4be6-b434-7943e20bbd82-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:20 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-5734e45f-13fd-4be6-b434-7943e20bbd82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "cinder-quobyte-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-quobyte-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "cinder-quobyte-5734e45f-13fd-4be6-b434-7943e20bbd82" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-quobyte-5734e45f-13fd-4be6-b434-7943e20bbd82" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Deleting offline snapshot 5734e45f-13fd-4be6-b434-7943e20bbd82 of volume 2cbeaf17-2383-4aa1-b6a7-ca827b4a601e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] snapshot_file for this snap is: volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c7d121-3d0e-4969-8c36-a9817007ef66]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:21 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 Jul 24 15:47:21 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:21 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 1G" returned: 0 in 0.684s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:21 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 Jul 24 15:47:21 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:21 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82" returned: 0 in 0.546s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4699cdac-fd7f-4091-a4e4-006314bc9c75]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:21 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e Jul 24 15:47:21 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:21 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728" returned: 0 in 0.496s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:21 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 is being set with open permissions: ugo+rw Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:21 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 Jul 24 15:47:21 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:21 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" returned: 0 in 0.477s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:22 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 Jul 24 15:47:22 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:22 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728" returned: 0 in 0.356s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:22 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.info Jul 24 15:47:22 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:22 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82" returned: 0 in 0.531s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:22 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82 Jul 24 15:47:22 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:22 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.info" returned: 0 in 0.449s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:22 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.info is being set with open permissions: ugo+rw Jul 24 15:47:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:22 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.info Jul 24 15:47:22 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:22 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e.5734e45f-13fd-4be6-b434-7943e20bbd82" returned: 0 in 0.432s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-quobyte-5734e45f-13fd-4be6-b434-7943e20bbd82" released by "_delete_snapshot" :: held 2.160s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-quobyte-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" released by "delete_snapshot" :: held 2.193s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Created reservations ['0549cf19-6a54-4e37-9104-bee835ed1a55', '1a4412b6-d8cb-4d06-a37d-6f85e06cc3fc', 'e3ec8eac-a18a-4366-a38f-85a93c664b42', '4a2d3e65-76bd-453b-bffa-320d4def9ff9'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:23 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.info" returned: 0 in 0.392s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.231s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Delete snapshot completed successfully. Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e3423983-23d1-4f9c-8946-3e5cce1e58b8 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-5734e45f-13fd-4be6-b434-7943e20bbd82-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-3bf918d3-0e3e-46b2-bd11-9c39b18cda89 req-66638cad-7b6a-459a-b1c3-99e068ed7ab9 tempest-VolumesSnapshotsTestJSON-570469410 None] Create snapshot completed successfully Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "cinder-028f6c19-352d-4436-ba55-65c525a0c728-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-028f6c19-352d-4436-ba55-65c525a0c728-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "cinder-quobyte-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-quobyte-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "cinder-quobyte-028f6c19-352d-4436-ba55-65c525a0c728" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-quobyte-028f6c19-352d-4436-ba55-65c525a0c728" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Deleting offline snapshot 028f6c19-352d-4436-ba55-65c525a0c728 of volume 1de4c17f-3d8d-4e96-aac9-7ff1af8f865e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] snapshot_file for this snap is: volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8581e-bcc5-4543-a70a-72aad40f0bd9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:24 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 Jul 24 15:47:24 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "cinder-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "cinder-quobyte-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-quobyte-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab2b945-dd1e-459b-8962-a002c4aaaedf]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:24 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728" returned: 0 in 0.524s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:47:24 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e Jul 24 15:47:24 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341302a-70c1-461b-95a7-47408c1222f6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:24 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e Jul 24 15:47:24 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:24 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" returned: 0 in 0.501s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:24 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e Jul 24 15:47:24 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:25 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" returned: 0 in 0.503s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:25 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 Jul 24 15:47:25 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:25 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" returned: 0 in 0.317s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-quobyte-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e" released by "delete_volume" :: held 0.904s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Created reservations ['26fbd105-9575-417a-8ac4-54c08f01e7f9', 'b4fb009d-e430-47aa-87e1-ecd8f4f32aa6', 'c185b5c8-c75d-4e7b-b61e-02189d7d2ff7', 'c8612c38-4ed7-4a91-960f-528f63e8b75a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:25 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:25 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:25 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728" returned: 0 in 0.529s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:25 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728 Jul 24 15:47:25 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:25 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.345s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Deleted volume successfully. Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-400f7c25-74ca-4ba7-b174-6e29938aeae6 tempest-VolumesSnapshotNegativeTestJSON-1848507423 None] Lock "cinder-2cbeaf17-2383-4aa1-b6a7-ca827b4a601e-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Flow 'volume_create_manager' (e3f476e1-fc83-4e47-ba88-6bcb7e1f569b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:25 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69740b26-e277-4e1d-8555-dd1a0ebf6b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e.028f6c19-352d-4436-ba55-65c525a0c728" returned: 0 in 0.387s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69740b26-e277-4e1d-8555-dd1a0ebf6b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477313262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596350fb-4ee3-4fe1-b1b0-b180571ccf29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='079ebb2ec368432ab35b40907c3b4594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:26Z,use_quota=True,user_id='e37ecd8a31ed4d8da692c89ad782ce1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5a8bff-bc72-4c85-be07-c4f46776075f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5a8bff-bc72-4c85-be07-c4f46776075f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58ac64d-eb20-49dc-9cee-6945e9c92206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58ac64d-eb20-49dc-9cee-6945e9c92206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596350fb-4ee3-4fe1-b1b0-b180571ccf29', 'volume_name': 'volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e181bbff-a7a5-4bc2-9b9a-efaad458e43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e181bbff-a7a5-4bc2-9b9a-efaad458e43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136dbdb5-2ec1-47cb-abe6-4570ed952111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Volume 596350fb-4ee3-4fe1-b1b0-b180571ccf29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29', 'volume_size': 1} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477313262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596350fb-4ee3-4fe1-b1b0-b180571ccf29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='079ebb2ec368432ab35b40907c3b4594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:26Z,use_quota=True,user_id='e37ecd8a31ed4d8da692c89ad782ce1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Creating volume 596350fb-4ee3-4fe1-b1b0-b180571ccf29 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:25 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:26 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 1073741824 Jul 24 15:47:26 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-quobyte-028f6c19-352d-4436-ba55-65c525a0c728" released by "_delete_snapshot" :: held 2.193s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-quobyte-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" released by "delete_snapshot" :: held 2.225s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.quota [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Created reservations ['082641a0-fe62-44c3-9595-fa26953a41f4', 'a1b379e6-49da-498d-88a6-26d7883f17b8', '10ac78bb-02b7-46bf-9487-bf1c8f56066a', '83f027b9-77fe-45df-ab10-1c123e798c17'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Delete snapshot completed successfully. Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-b48ee651-ee4f-4fe3-ba1e-2491a40e5a68 req-1c92f582-2b86-451c-8f54-9b5563168675 tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-028f6c19-352d-4436-ba55-65c525a0c728-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:26 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 1073741824" returned: 0 in 0.555s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:26 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 Jul 24 15:47:26 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:26 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29" returned: 0 in 0.274s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136dbdb5-2ec1-47cb-abe6-4570ed952111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6065b7ef-677e-4dc2-9c95-6eb4a6fb2d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Volume volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 (596350fb-4ee3-4fe1-b1b0-b180571ccf29): created successfully Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6065b7ef-677e-4dc2-9c95-6eb4a6fb2d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Flow 'volume_create_manager' (e3f476e1-fc83-4e47-ba88-6bcb7e1f569b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-cc93309e-6c5f-4e98-acdf-9a6e670d1d09 tempest-VolumesListTestJSON-643579022 None] Created volume successfully. Jul 24 15:47:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "cinder-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "cinder-quobyte-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-quobyte-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:27 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e7b1dc-89bc-4adf-8977-54f62daeb32c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:27 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e Jul 24 15:47:27 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:27 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" returned: 0 in 0.440s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:27 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e Jul 24 15:47:27 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:28 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" returned: 0 in 0.335s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-quobyte-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e" released by "delete_volume" :: held 0.883s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG cinder.quota [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Created reservations ['bb4f0aee-4b8c-492f-b483-3d49e4e4a7bf', '30fa3357-c60c-4546-938d-1cc33bf32f5e', 'dd08c3d1-343f-407e-a687-c8b28336bc8e', 'fa9ad145-9cc8-441f-a3ff-a65e23d63637'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:28 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:28 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:28 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.404s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG cinder.manager [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Deleted volume successfully. Jul 24 15:47:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-40d1d3ae-69e1-47c6-9e64-0a6e44dd2b55 req-6f976255-fd70-410b-9bcb-de02adfc4baa tempest-VolumesSnapshotsTestJSON-570469410 None] Lock "cinder-1de4c17f-3d8d-4e96-aac9-7ff1af8f865e-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Flow 'volume_create_manager' (7149f31a-90e4-4386-8084-94fee0dc0bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc63124-262c-45b2-b3b0-a3503a518ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc63124-262c-45b2-b3b0-a3503a518ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-257571874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b51877c-6f67-4b0f-a7b9-f9e511598e75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='079ebb2ec368432ab35b40907c3b4594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:29Z,use_quota=True,user_id='e37ecd8a31ed4d8da692c89ad782ce1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec68d9c4-9cf1-4427-b75b-ef351107dacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec68d9c4-9cf1-4427-b75b-ef351107dacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e88152-e2e5-492e-ba90-765667d12bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e88152-e2e5-492e-ba90-765667d12bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b51877c-6f67-4b0f-a7b9-f9e511598e75', 'volume_name': 'volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d043e6-3bdb-41f0-bf12-50c3f3a5cc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d043e6-3bdb-41f0-bf12-50c3f3a5cc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8895e3a-d285-4c5a-9134-e83dc6bef663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:29 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Volume 0b51877c-6f67-4b0f-a7b9-f9e511598e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75', 'volume_size': 1} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-257571874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b51877c-6f67-4b0f-a7b9-f9e511598e75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='079ebb2ec368432ab35b40907c3b4594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:29Z,use_quota=True,user_id='e37ecd8a31ed4d8da692c89ad782ce1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Creating volume 0b51877c-6f67-4b0f-a7b9-f9e511598e75 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:29 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:29 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 1073741824 Jul 24 15:47:29 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:29 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 1073741824" returned: 0 in 0.585s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:29 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 Jul 24 15:47:29 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:30 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75" returned: 0 in 0.383s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8895e3a-d285-4c5a-9134-e83dc6bef663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b2edd1-6788-476e-898c-1450c3b1c828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:30 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Volume volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 (0b51877c-6f67-4b0f-a7b9-f9e511598e75): created successfully Jul 24 15:47:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b2edd1-6788-476e-898c-1450c3b1c828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Flow 'volume_create_manager' (7149f31a-90e4-4386-8084-94fee0dc0bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1bfa540a-dcfd-4bcf-b21e-d9d475bf6217 tempest-VolumesListTestJSON-643579022 None] Created volume successfully. Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Flow 'volume_create_manager' (9eb4acc1-f067-41c5-bc99-44bf1842d7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (accf03c9-16d4-4c54-84b9-08f8d420f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (accf03c9-16d4-4c54-84b9-08f8d420f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-570342969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd151f9-03e8-4c22-a507-cd5608919214,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='079ebb2ec368432ab35b40907c3b4594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:32Z,use_quota=True,user_id='e37ecd8a31ed4d8da692c89ad782ce1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26e9712-49b8-44e2-8fd6-f96a57a5cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26e9712-49b8-44e2-8fd6-f96a57a5cd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4992cb-12c1-45ab-ba76-091bf774ad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4992cb-12c1-45ab-ba76-091bf774ad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd151f9-03e8-4c22-a507-cd5608919214', 'volume_name': 'volume-bbd151f9-03e8-4c22-a507-cd5608919214', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ffe811-db00-42d9-8e67-38b5f0090004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ffe811-db00-42d9-8e67-38b5f0090004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8650212a-fd05-4b9b-887f-d2cf86f7dd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:32 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Volume bbd151f9-03e8-4c22-a507-cd5608919214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd151f9-03e8-4c22-a507-cd5608919214', 'volume_size': 1} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-570342969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd151f9-03e8-4c22-a507-cd5608919214,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='079ebb2ec368432ab35b40907c3b4594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:32Z,use_quota=True,user_id='e37ecd8a31ed4d8da692c89ad782ce1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Creating volume bbd151f9-03e8-4c22-a507-cd5608919214 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:32 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:32 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 1073741824 Jul 24 15:47:32 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:32 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 1073741824" returned: 0 in 0.672s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:32 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 Jul 24 15:47:32 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:33 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214" returned: 0 in 0.366s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=120,cinder:UPDATE=139,cinder:DELETE=9,cinder:INSERT=32 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8650212a-fd05-4b9b-887f-d2cf86f7dd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd151f9-03e8-4c22-a507-cd5608919214', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e127be4-e8f4-4211-8a6b-108003247184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=122,cinder:UPDATE=133,cinder:DELETE=12,cinder:INSERT=37 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:47:33 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Volume volume-bbd151f9-03e8-4c22-a507-cd5608919214 (bbd151f9-03e8-4c22-a507-cd5608919214): created successfully Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e127be4-e8f4-4211-8a6b-108003247184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Flow 'volume_create_manager' (9eb4acc1-f067-41c5-bc99-44bf1842d7ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:33 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8c9c3163-4536-4e85-997d-dc2cdf2a8187 tempest-VolumesListTestJSON-643579022 None] Created volume successfully. Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Flow 'volume_create_manager' (a14ebbe0-7e41-4a86-ae15-3d9ac908012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1499671-611c-4e70-abff-dc2b2db98d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1499671-611c-4e70-abff-dc2b2db98d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-145772869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019ea22c-af5d-4fac-8cac-73ef3949d074,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f98a5b981b640dc887d1e251e0d1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:35Z,use_quota=True,user_id='b10bf3a35d7c446094f7f2f2ab68a90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3173e3-581f-4ce3-94c3-03bdf34253a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3173e3-581f-4ce3-94c3-03bdf34253a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cf4441-79b0-43d9-bb1b-8ea3c81ce563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cf4441-79b0-43d9-bb1b-8ea3c81ce563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '019ea22c-af5d-4fac-8cac-73ef3949d074', 'volume_name': 'volume-019ea22c-af5d-4fac-8cac-73ef3949d074', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1b4a09-214c-4799-a7ec-e4c0a547edba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1b4a09-214c-4799-a7ec-e4c0a547edba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b1eaab-2694-40c2-8503-e4faa656ec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Volume 019ea22c-af5d-4fac-8cac-73ef3949d074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-019ea22c-af5d-4fac-8cac-73ef3949d074', 'volume_size': 1} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-145772869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019ea22c-af5d-4fac-8cac-73ef3949d074,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f98a5b981b640dc887d1e251e0d1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:35Z,use_quota=True,user_id='b10bf3a35d7c446094f7f2f2ab68a90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Creating volume 019ea22c-af5d-4fac-8cac-73ef3949d074 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:34 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:34 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 1073741824 Jul 24 15:47:34 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:34 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:34 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:35 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.698s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:47:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 28 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:47:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:47:35 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 1073741824" returned: 0 in 1.213s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:36 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 Jul 24 15:47:36 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:36 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074" returned: 0 in 0.534s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b1eaab-2694-40c2-8503-e4faa656ec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019ea22c-af5d-4fac-8cac-73ef3949d074', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59236d5c-1724-4ecf-b8f2-38a27c4df6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:36 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Volume volume-019ea22c-af5d-4fac-8cac-73ef3949d074 (019ea22c-af5d-4fac-8cac-73ef3949d074): created successfully Jul 24 15:47:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59236d5c-1724-4ecf-b8f2-38a27c4df6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Flow 'volume_create_manager' (a14ebbe0-7e41-4a86-ae15-3d9ac908012f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:36 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-11f7cec7-c194-48e5-945e-aef7a8002f26 req-be98d9a3-95f4-42b7-93d8-32b5a535ba22 tempest-VolumesGetTestJSON-248869676 None] Created volume successfully. Jul 24 15:47:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Acquiring lock "cinder-019ea22c-af5d-4fac-8cac-73ef3949d074-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Lock "cinder-019ea22c-af5d-4fac-8cac-73ef3949d074-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Acquiring lock "cinder-quobyte-019ea22c-af5d-4fac-8cac-73ef3949d074" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Lock "cinder-quobyte-019ea22c-af5d-4fac-8cac-73ef3949d074" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:37 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb4783-8ae0-4cb6-884f-425e6527178b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:37 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 Jul 24 15:47:37 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:37 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074" returned: 0 in 0.518s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:37 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074 Jul 24 15:47:37 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "cinder-bbd151f9-03e8-4c22-a507-cd5608919214-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Lock "cinder-bbd151f9-03e8-4c22-a507-cd5608919214-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "cinder-quobyte-bbd151f9-03e8-4c22-a507-cd5608919214" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Lock "cinder-quobyte-bbd151f9-03e8-4c22-a507-cd5608919214" acquired by "delete_volume" :: waited 0.048s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5ce272-c2f0-4e4a-b5d4-a4c75363b5be]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:38 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-019ea22c-af5d-4fac-8cac-73ef3949d074" returned: 0 in 0.833s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Lock "cinder-quobyte-019ea22c-af5d-4fac-8cac-73ef3949d074" released by "delete_volume" :: held 1.451s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:38 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 Jul 24 15:47:38 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:38 devstack cinder-volume[88251]: DEBUG cinder.quota [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Created reservations ['4622f425-bb10-4e5d-91cb-fae7c213fe1c', '36b58f06-fc9f-4a45-9766-c1281a619f0c', 'b1e1e46e-4c58-4105-b5f0-fd1c32fc2c92', '64cecc04-c03c-4bee-b191-da08295ed816'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:39 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:39 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:39 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214" returned: 0 in 0.682s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:39 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214 Jul 24 15:47:39 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:39 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.383s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG cinder.manager [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:39 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Deleted volume successfully. Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-4136c3e1-ea92-4e91-9ac1-2e339ab1f6c6 req-d3aff2da-f84b-4e36-b52d-838413070de2 tempest-VolumesGetTestJSON-248869676 None] Lock "cinder-019ea22c-af5d-4fac-8cac-73ef3949d074-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:39 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bbd151f9-03e8-4c22-a507-cd5608919214" returned: 0 in 0.374s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Lock "cinder-quobyte-bbd151f9-03e8-4c22-a507-cd5608919214" released by "delete_volume" :: held 1.211s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Created reservations ['f8576be2-4559-48ea-aa2c-333a6ffe5282', '16a01ea5-7919-4f23-9233-873029b2ead3', 'a70d3cbf-2cfb-4c12-8e23-57c253d48695', '19c0e44d-97aa-4669-be1a-f01d9d60ec13'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:39 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:39 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:40 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.517s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:40 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:40 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Deleted volume successfully. Jul 24 15:47:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8d7d896f-b530-434a-be67-cbfefb951480 tempest-VolumesListTestJSON-643579022 None] Lock "cinder-bbd151f9-03e8-4c22-a507-cd5608919214-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "cinder-0b51877c-6f67-4b0f-a7b9-f9e511598e75-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Lock "cinder-0b51877c-6f67-4b0f-a7b9-f9e511598e75-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "cinder-quobyte-0b51877c-6f67-4b0f-a7b9-f9e511598e75" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Lock "cinder-quobyte-0b51877c-6f67-4b0f-a7b9-f9e511598e75" acquired by "delete_volume" :: waited 0.042s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71a1b26-5487-4371-a3ca-09ac73a42046]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:41 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 Jul 24 15:47:41 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:41 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75" returned: 0 in 0.544s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:41 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75 Jul 24 15:47:41 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:41 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b51877c-6f67-4b0f-a7b9-f9e511598e75" returned: 0 in 0.350s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Lock "cinder-quobyte-0b51877c-6f67-4b0f-a7b9-f9e511598e75" released by "delete_volume" :: held 0.979s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Created reservations ['d96201bf-ec44-4cf1-8626-2ad36fc57de4', '47321a14-1abc-4289-88e8-6fbbcb8b4a8c', '1853a96a-3675-4661-8d8e-66bc50b67ad6', '782379d6-bb89-44a5-b93f-252340a0219f'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:42 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:42 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:42 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.484s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Deleted volume successfully. Jul 24 15:47:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0c26d9c3-6e13-4b16-b20c-5e43db79c396 tempest-VolumesListTestJSON-643579022 None] Lock "cinder-0b51877c-6f67-4b0f-a7b9-f9e511598e75-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Acquiring lock "cinder-596350fb-4ee3-4fe1-b1b0-b180571ccf29-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Lock "cinder-596350fb-4ee3-4fe1-b1b0-b180571ccf29-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Acquiring lock "cinder-quobyte-596350fb-4ee3-4fe1-b1b0-b180571ccf29" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Lock "cinder-quobyte-596350fb-4ee3-4fe1-b1b0-b180571ccf29" acquired by "delete_volume" :: waited 0.036s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:43 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b482fe-25b5-4037-aabb-69299d3994b0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:43 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 Jul 24 15:47:43 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:44 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29" returned: 0 in 0.696s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:44 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29 Jul 24 15:47:44 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:44 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-596350fb-4ee3-4fe1-b1b0-b180571ccf29" returned: 0 in 0.646s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Lock "cinder-quobyte-596350fb-4ee3-4fe1-b1b0-b180571ccf29" released by "delete_volume" :: held 1.412s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Created reservations ['5f6f2c7b-a5e6-4640-9c74-96223e3a8894', 'e7e3e6ec-d7a8-4e12-a471-169a0e1f97c5', '48c2ff6e-bf39-40dc-b25c-cdbca52dfa0e', '52f25aff-0051-4cfc-aa82-63001b74527f'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:45 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:47:45 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:45 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.600s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Deleted volume successfully. Jul 24 15:47:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d94ca4e1-754d-493f-b143-5c6ef1cf9e8d tempest-VolumesListTestJSON-643579022 None] Lock "cinder-596350fb-4ee3-4fe1-b1b0-b180571ccf29-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-67a5bba8-05fb-4402-b954-836fba24a979 tempest-GroupSnapshotsTest-819794554 None] Group tempest-GroupSnapshotsTest-Group-1291553871: creating Jul 24 15:47:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-67a5bba8-05fb-4402-b954-836fba24a979 tempest-GroupSnapshotsTest-819794554 None] Group tempest-GroupSnapshotsTest-Group-1291553871: created successfully Jul 24 15:47:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-67a5bba8-05fb-4402-b954-836fba24a979 tempest-GroupSnapshotsTest-819794554 None] Create group completed successfully. Jul 24 15:47:50 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Flow 'volume_create_manager' (ac7a2a09-0788-4197-a8bd-5392cfb24833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829667fc-a522-44cd-a3d6-467ff52f0d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829667fc-a522-44cd-a3d6-467ff52f0d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-317599389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a3ef81-02c9-49ed-877a-624fec93f45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0770021f3904644ac8acb29cb5d4c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:51Z,use_quota=True,user_id='5bb38a531cec4e2ebfc072f1f4e31f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0940ec5-436b-4497-8b79-a5c61a9a5b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0940ec5-436b-4497-8b79-a5c61a9a5b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779bf05b-8c35-46d0-b61c-33afcd1a4c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779bf05b-8c35-46d0-b61c-33afcd1a4c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a3ef81-02c9-49ed-877a-624fec93f45f', 'volume_name': 'volume-08a3ef81-02c9-49ed-877a-624fec93f45f', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee5b8d1-483d-46bb-991b-857463aa4100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee5b8d1-483d-46bb-991b-857463aa4100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a73e8d0-6de8-4078-aebe-93936d7b71d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Volume 08a3ef81-02c9-49ed-877a-624fec93f45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a3ef81-02c9-49ed-877a-624fec93f45f', 'volume_size': 1} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-317599389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a3ef81-02c9-49ed-877a-624fec93f45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0770021f3904644ac8acb29cb5d4c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:51Z,use_quota=True,user_id='5bb38a531cec4e2ebfc072f1f4e31f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Creating volume 08a3ef81-02c9-49ed-877a-624fec93f45f {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:51 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:51 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f 1073741824 Jul 24 15:47:51 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Flow 'volume_create_manager' (ba319cee-7fbf-448e-95f9-1d562d5b2abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26bb67d-6d83-4de9-9f2e-8244c4779951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26bb67d-6d83-4de9-9f2e-8244c4779951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1642916215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a215355-6653-4674-9877-aee98e32c757,host='devstack@QuobyteHD#QuobyteHD',id=4b0b88cb-08cd-463a-b1de-bbbe50a13fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce77570ad89148599d999070f114268b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:51Z,use_quota=True,user_id='f1f8d45b6aad486eb74686d2f6345c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b996acc-675e-4225-b2ee-77ab07b9ef44),volume_type_id=2b996acc-675e-4225-b2ee-77ab07b9ef44)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b5a93e-7168-4551-a641-fb94f7d5429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b5a93e-7168-4551-a641-fb94f7d5429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e872418-0a7e-4f19-a389-f3e795fc31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e872418-0a7e-4f19-a389-f3e795fc31b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0b88cb-08cd-463a-b1de-bbbe50a13fb5', 'volume_name': 'volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c85937f-aa56-45c9-bb9a-a2ff4e8004f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c85937f-aa56-45c9-bb9a-a2ff4e8004f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f04ea22-1236-42e5-92d2-a0bacf9ce31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Volume 4b0b88cb-08cd-463a-b1de-bbbe50a13fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5', 'volume_size': 1} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:51 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f 1073741824" returned: 0 in 0.526s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:51 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f Jul 24 15:47:51 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:51 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f" returned: 0 in 0.288s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9a215355-6653-4674-9877-aee98e32c757,created_at=2026-07-24T13:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1642916215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a215355-6653-4674-9877-aee98e32c757,host='devstack@QuobyteHD#QuobyteHD',id=4b0b88cb-08cd-463a-b1de-bbbe50a13fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce77570ad89148599d999070f114268b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:51Z,use_quota=True,user_id='f1f8d45b6aad486eb74686d2f6345c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b996acc-675e-4225-b2ee-77ab07b9ef44),volume_type_id=2b996acc-675e-4225-b2ee-77ab07b9ef44)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Creating volume 4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:51 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:47:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a73e8d0-6de8-4078-aebe-93936d7b71d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a3ef81-02c9-49ed-877a-624fec93f45f', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:52 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 1073741824 Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f705f36-e1b7-49da-b295-8c4189ffabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:52 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:52 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Volume volume-08a3ef81-02c9-49ed-877a-624fec93f45f (08a3ef81-02c9-49ed-877a-624fec93f45f): created successfully Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f705f36-e1b7-49da-b295-8c4189ffabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Flow 'volume_create_manager' (ac7a2a09-0788-4197-a8bd-5392cfb24833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e143d716-7371-48fb-b1f1-a5fbcff856b3 tempest-VolumesNegativeTest-1260745931 None] Created volume successfully. Jul 24 15:47:52 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 1073741824" returned: 0 in 0.491s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:52 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 Jul 24 15:47:52 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:52 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" returned: 0 in 0.248s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f04ea22-1236-42e5-92d2-a0bacf9ce31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127d2c94-9f85-4c96-a895-6e0354f5009c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:52 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Volume volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 (4b0b88cb-08cd-463a-b1de-bbbe50a13fb5): created successfully Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127d2c94-9f85-4c96-a895-6e0354f5009c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Flow 'volume_create_manager' (ba319cee-7fbf-448e-95f9-1d562d5b2abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-10d47dee-e86d-4d75-9977-4ae7defb7755 tempest-GroupSnapshotsTest-819794554 None] Created volume successfully. Jul 24 15:47:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] GroupSnapshot fa3848d6-9824-4a12-96a5-9349432c91cc: creating. Jul 24 15:47:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Group snapshot fa3848d6-9824-4a12-96a5-9349432c91cc: creating. {{(pid=88251) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 15:47:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Creating offline snapshot fddcdef6-8c19-4314-b72f-012a3c7e9c18 of volume 4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:47:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb03f37-9e35-448c-8fd1-e6c8a9d5e541]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:54 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 Jul 24 15:47:54 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:54 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" returned: 0 in 0.733s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:54 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 1G Jul 24 15:47:54 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:55 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 1G" returned: 0 in 0.558s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:55 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 Jul 24 15:47:55 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:55 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18" returned: 0 in 0.454s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:55 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:47:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:55 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 Jul 24 15:47:55 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:56 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18" returned: 0 in 0.321s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:56 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.info Jul 24 15:47:56 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:56 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.info" returned: 0 in 0.428s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:56 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:47:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:56 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.info Jul 24 15:47:56 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:56 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.info" returned: 0 in 0.354s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.974s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:57 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-83cbc509-b3cc-4c55-89dc-df7a7401932c tempest-GroupSnapshotsTest-819794554 None] group_snapshot fa3848d6-9824-4a12-96a5-9349432c91cc: created successfully Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-fddcdef6-8c19-4314-b72f-012a3c7e9c18-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-fddcdef6-8c19-4314-b72f-012a3c7e9c18-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Creating volume 120bc6ab-1073-4d67-b89e-dfec8c7f8b9b from snapshot fddcdef6-8c19-4314-b72f-012a3c7e9c18 {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] snapshot: fddcdef6-8c19-4314-b72f-012a3c7e9c18, volume: 120bc6ab-1073-4d67-b89e-dfec8c7f8b9b, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c542bfd7-5459-4ba6-8233-5b699a10f14d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:58 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 Jul 24 15:47:58 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:58 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18" returned: 0 in 0.548s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[879e5e6d-f5bc-4387-b156-87ea9406a84c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:59 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 Jul 24 15:47:59 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:59 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" returned: 0 in 0.540s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:59 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:47:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:59 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b Jul 24 15:47:59 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Flow 'volume_create_manager' (b5504417-9830-44d8-b063-be940946f376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e62a51-182c-4fda-a001-50d81d3ad47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e62a51-182c-4fda-a001-50d81d3ad47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-69453666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b9db90-db80-4617-8573-36d6f3c31aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5adfb6121124fe7a92f2181ad26f5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:07Z,use_quota=True,user_id='ec238608b2284dd3ad837cb0f38feeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f224505-53ad-4a43-8763-9c56d7b1f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f224505-53ad-4a43-8763-9c56d7b1f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452ac9f9-9fcf-439f-9a2d-0c58f4d394f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452ac9f9-9fcf-439f-9a2d-0c58f4d394f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b9db90-db80-4617-8573-36d6f3c31aec', 'volume_name': 'volume-c0b9db90-db80-4617-8573-36d6f3c31aec', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7004f7bb-3dbc-47ba-accb-6ca9315cff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7004f7bb-3dbc-47ba-accb-6ca9315cff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2e39e7-ca24-4a08-8227-3b5ff1dcb10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:06 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Volume c0b9db90-db80-4617-8573-36d6f3c31aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b9db90-db80-4617-8573-36d6f3c31aec', 'volume_size': 1} Jul 24 15:48:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:07 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" returned: 0 in 8.394s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6beb3-7aaa-4868-b6cf-4b9d7183d78a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:08 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 Jul 24 15:48:08 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:08 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" returned: 0 in 0.806s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:08 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5, size 1024.00 MB, duration 8.39 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:48:08 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Converted 1024.00 MB image at 121.98 MB/s Jul 24 15:48:08 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:48:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:08 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b Jul 24 15:48:08 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:09 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" returned: 0 in 0.415s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" released by "_copy_volume_from_snapshot" :: held 10.858s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-fddcdef6-8c19-4314-b72f-012a3c7e9c18-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" released by "_create_volume_from_snapshot" :: held 10.901s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.924s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.289s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-69453666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b9db90-db80-4617-8573-36d6f3c31aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5adfb6121124fe7a92f2181ad26f5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:07Z,use_quota=True,user_id='ec238608b2284dd3ad837cb0f38feeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Creating volume c0b9db90-db80-4617-8573-36d6f3c31aec {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:09 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:09 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec 1073741824 Jul 24 15:48:09 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e4f1089e-0579-4cb0-9794-45f4c7e30784 tempest-GroupSnapshotsTest-819794554 None] Create group from source-snapshot-fa3848d6-9824-4a12-96a5-9349432c91cc completed successfully. Jul 24 15:48:09 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec 1073741824" returned: 0 in 0.637s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:09 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec Jul 24 15:48:09 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:10 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec" returned: 0 in 0.498s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2e39e7-ca24-4a08-8227-3b5ff1dcb10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b9db90-db80-4617-8573-36d6f3c31aec', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e398e29d-7cc5-4f01-91c7-c61556ce50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:10 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Volume volume-c0b9db90-db80-4617-8573-36d6f3c31aec (c0b9db90-db80-4617-8573-36d6f3c31aec): created successfully Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e398e29d-7cc5-4f01-91c7-c61556ce50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Flow 'volume_create_manager' (b5504417-9830-44d8-b063-be940946f376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:10 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0bf4b1ad-c39f-4afb-a3f6-1833bf2d59fe tempest-AttachVolumeNegativeTest-553811594 None] Created volume successfully. Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eb9540-046f-47c8-baa2-1a68c341c47a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:10 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b Jul 24 15:48:10 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:11 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" returned: 0 in 0.449s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:11 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b Jul 24 15:48:11 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:11 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" returned: 0 in 0.375s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-120bc6ab-1073-4d67-b89e-dfec8c7f8b9b" released by "delete_volume" :: held 0.888s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Created reservations ['9716acbe-b80f-4073-a745-72b955e59133'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:11 devstack cinder-volume[88251]: WARNING cinder.quota [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-611564727 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-611564727, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:48:11 devstack cinder-volume[88251]: WARNING cinder.quota [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-611564727 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-611564727, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Created reservations ['092a26b1-49a7-4b6a-bf20-02e5d1dd9bb0', '0fdd344a-d6d4-4858-9740-df98d2e30e9e', '6d9669c5-77ae-4a15-840d-a7d4cf3bd6f9', 'aafdb96b-3cd2-4b8c-aeb1-f4c5136a80bf'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:11 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:11 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] group_snapshot fa3848d6-9824-4a12-96a5-9349432c91cc: deleting Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] group_snapshot fa3848d6-9824-4a12-96a5-9349432c91cc: deleting {{(pid=88251) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-fddcdef6-8c19-4314-b72f-012a3c7e9c18" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-fddcdef6-8c19-4314-b72f-012a3c7e9c18" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Deleting offline snapshot fddcdef6-8c19-4314-b72f-012a3c7e9c18 of volume 4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] snapshot_file for this snap is: volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b04b45-f2a4-42a4-83e3-bd00440eac1d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-1fbdf190-8d34-4cae-b565-8845726abb3d req-5d4fc76e-62b6-4e82-84ce-26dcf5b1cf21 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-1fbdf190-8d34-4cae-b565-8845726abb3d req-5d4fc76e-62b6-4e82-84ce-26dcf5b1cf21 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-1fbdf190-8d34-4cae-b565-8845726abb3d req-5d4fc76e-62b6-4e82-84ce-26dcf5b1cf21 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:12 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.393s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7cb405ca-2fcd-4750-b453-8cbeb7fce0c5 tempest-GroupSnapshotsTest-819794554 None] Delete group completed successfully. Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-1fbdf190-8d34-4cae-b565-8845726abb3d req-5d4fc76e-62b6-4e82-84ce-26dcf5b1cf21 tempest-AttachVolumeNegativeTest-553811594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-c0b9db90-db80-4617-8573-36d6f3c31aec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a457ff5-4579-4fac-b42f-07f65b4b4304', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:48:12 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 Jul 24 15:48:12 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-1fbdf190-8d34-4cae-b565-8845726abb3d req-5d4fc76e-62b6-4e82-84ce-26dcf5b1cf21 tempest-AttachVolumeNegativeTest-553811594 None] attachment_update completed successfully. Jul 24 15:48:12 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18" returned: 0 in 0.608s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2694862b-99e4-4998-ab97-e436fdb9f991]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:13 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 Jul 24 15:48:13 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:13 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" returned: 0 in 0.533s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:13 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 Jul 24 15:48:13 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:13 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18" returned: 0 in 0.518s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:13 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18 Jul 24 15:48:13 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:14 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5.fddcdef6-8c19-4314-b72f-012a3c7e9c18" returned: 0 in 0.345s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-fddcdef6-8c19-4314-b72f-012a3c7e9c18" released by "_delete_snapshot" :: held 2.141s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" released by "delete_snapshot" :: held 2.175s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:14 devstack cinder-volume[88251]: WARNING cinder.quota [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-611564727 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-611564727, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:48:14 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] Created reservations ['272c1bc0-1844-4aef-ac2f-2c3b118556b4', '7e4fe256-2163-40f1-a859-76b2fbe154e7', 'f9057db4-dc85-4ac6-933d-7aaf3f5296c2', '40809f70-0b9a-46f7-bcb5-5d28d16f117c'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-992a3fcd-2dbf-48ec-b661-a727cb719f43 tempest-GroupSnapshotsTest-819794554 None] group_snapshot fa3848d6-9824-4a12-96a5-9349432c91cc: deleted successfully Jul 24 15:48:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:15 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9a9ac3-e218-47d9-a926-93700f848a14]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:15 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 Jul 24 15:48:15 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:15 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" returned: 0 in 0.526s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:15 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5 Jul 24 15:48:15 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-c2ed6656-420c-406c-89c8-e789c280936e req-9ae760ba-2f1e-4a5d-8c7d-b7437d749f6c tempest-AttachVolumeNegativeTest-553811594 None] Terminate volume connection completed successfully. Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-c2ed6656-420c-406c-89c8-e789c280936e req-9ae760ba-2f1e-4a5d-8c7d-b7437d749f6c tempest-AttachVolumeNegativeTest-553811594 None] Deleting attachment 2a457ff5-4579-4fac-b42f-07f65b4b4304. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:48:16 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" returned: 0 in 0.461s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-4b0b88cb-08cd-463a-b1de-bbbe50a13fb5" released by "delete_volume" :: held 1.068s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Created reservations ['14ba5b99-6b2e-4976-84cd-28a6f8f1a680'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:16 devstack cinder-volume[88251]: WARNING cinder.db.api [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-611564727'] Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Created reservations ['d7ae7a76-052b-4905-bd40-1a16e66dbfd3', '96f70365-1ec8-45e2-a080-71072f2351e1', '8564bf07-193b-44c7-856e-e6f135f52dfe', '89891fc2-9be8-415c-ac5f-d3d6fa51bbd9'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:16 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:16 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:16 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.350s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:16 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-47476fac-a465-49e1-9fc7-64f592b79213 tempest-GroupSnapshotsTest-819794554 None] Delete group completed successfully. Jul 24 15:48:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0b7e9afb-3f77-4f88-a72d-460680123f4a tempest-GroupSnapshotsTest-819794554 None] Group tempest-GroupSnapshotsTest-Group-1423814008: creating Jul 24 15:48:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0b7e9afb-3f77-4f88-a72d-460680123f4a tempest-GroupSnapshotsTest-819794554 None] Group tempest-GroupSnapshotsTest-Group-1423814008: created successfully Jul 24 15:48:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0b7e9afb-3f77-4f88-a72d-460680123f4a tempest-GroupSnapshotsTest-819794554 None] Create group completed successfully. Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Flow 'volume_create_manager' (55a95718-935e-44e5-af34-f6ce1048a64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee75de1-79c1-4aae-a5df-cef2eb02e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee75de1-79c1-4aae-a5df-cef2eb02e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-288491685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f62543ba-8a20-40c0-9c5b-9bbd381e778a,host='devstack@QuobyteHD#QuobyteHD',id=2d01440f-afd9-41b4-93a5-b9765bdb94dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce77570ad89148599d999070f114268b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:21Z,use_quota=True,user_id='f1f8d45b6aad486eb74686d2f6345c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0578be87-2b86-4070-b8a2-3fb1a7cb4d69),volume_type_id=0578be87-2b86-4070-b8a2-3fb1a7cb4d69)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae4298f-2b80-44d1-97f9-c0eb4f87bc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae4298f-2b80-44d1-97f9-c0eb4f87bc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78cb4fd-784d-4348-9b6c-cf69cd4e4c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78cb4fd-784d-4348-9b6c-cf69cd4e4c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d01440f-afd9-41b4-93a5-b9765bdb94dd', 'volume_name': 'volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e06c3fb-6d35-4e43-a769-e2fabdfdeb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e06c3fb-6d35-4e43-a769-e2fabdfdeb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40215a1-299b-4aac-9a39-da48f30abbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Volume 2d01440f-afd9-41b4-93a5-b9765bdb94dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd', 'volume_size': 1} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f62543ba-8a20-40c0-9c5b-9bbd381e778a,created_at=2026-07-24T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-288491685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f62543ba-8a20-40c0-9c5b-9bbd381e778a,host='devstack@QuobyteHD#QuobyteHD',id=2d01440f-afd9-41b4-93a5-b9765bdb94dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce77570ad89148599d999070f114268b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:21Z,use_quota=True,user_id='f1f8d45b6aad486eb74686d2f6345c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0578be87-2b86-4070-b8a2-3fb1a7cb4d69),volume_type_id=0578be87-2b86-4070-b8a2-3fb1a7cb4d69)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Creating volume 2d01440f-afd9-41b4-93a5-b9765bdb94dd {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:20 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:20 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd 1073741824 Jul 24 15:48:20 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Acquiring lock "cinder-08a3ef81-02c9-49ed-877a-624fec93f45f-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Lock "cinder-08a3ef81-02c9-49ed-877a-624fec93f45f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:21 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd 1073741824" returned: 0 in 0.924s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Acquiring lock "cinder-quobyte-08a3ef81-02c9-49ed-877a-624fec93f45f" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Lock "cinder-quobyte-08a3ef81-02c9-49ed-877a-624fec93f45f" acquired by "delete_volume" :: waited 0.043s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e4231-fca3-4d9c-b4e8-41e6830c2967]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:21 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd Jul 24 15:48:21 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:22 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f Jul 24 15:48:22 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:22 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd" returned: 0 in 0.397s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40215a1-299b-4aac-9a39-da48f30abbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4987d4f-ec00-4e1f-a663-0f3c557058b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:22 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Volume volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd (2d01440f-afd9-41b4-93a5-b9765bdb94dd): created successfully Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4987d4f-ec00-4e1f-a663-0f3c557058b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Flow 'volume_create_manager' (55a95718-935e-44e5-af34-f6ce1048a64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:22 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e4a312b4-44d9-4b74-986d-50beaa8104bf tempest-GroupSnapshotsTest-819794554 None] Created volume successfully. Jul 24 15:48:22 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f" returned: 0 in 0.672s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:22 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f Jul 24 15:48:22 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:22 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-08a3ef81-02c9-49ed-877a-624fec93f45f" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Lock "cinder-quobyte-08a3ef81-02c9-49ed-877a-624fec93f45f" released by "delete_volume" :: held 1.112s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:22 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Created reservations ['52546408-731e-437b-8738-4896dc0b7f44', '8b2f97e4-b60a-4857-a0dc-9b73004a9553', 'b16f2368-4147-49c5-9661-21bb30cfb320', 'eb3e07c3-b487-40c8-a6fa-d25cea47ed76'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:23 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:23 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:23 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.364s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Deleted volume successfully. Jul 24 15:48:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5e2785d4-ce3a-4a5f-a42c-3b823eb22cc2 tempest-VolumesNegativeTest-1260745931 None] Lock "cinder-08a3ef81-02c9-49ed-877a-624fec93f45f-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "cinder-c0b9db90-db80-4617-8573-36d6f3c31aec-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-c0b9db90-db80-4617-8573-36d6f3c31aec-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "cinder-quobyte-c0b9db90-db80-4617-8573-36d6f3c31aec" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-quobyte-c0b9db90-db80-4617-8573-36d6f3c31aec" acquired by "delete_volume" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[007dc1fe-2d14-4ace-a61c-420318e78cf9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:24 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec Jul 24 15:48:24 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Flow 'volume_create_manager' (845cbaa4-f767-414d-b86d-0681e2136c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765900ba-0bb1-4f99-abc4-5ef76009fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765900ba-0bb1-4f99-abc4-5ef76009fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2070709316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f62543ba-8a20-40c0-9c5b-9bbd381e778a,host='devstack@QuobyteHD#QuobyteHD',id=a6001e95-873d-43ec-b4b8-a1f46c107d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce77570ad89148599d999070f114268b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:24Z,use_quota=True,user_id='f1f8d45b6aad486eb74686d2f6345c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0578be87-2b86-4070-b8a2-3fb1a7cb4d69),volume_type_id=0578be87-2b86-4070-b8a2-3fb1a7cb4d69)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34311615-849d-4704-a496-7dd9df0c9ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34311615-849d-4704-a496-7dd9df0c9ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec2f708-1139-4063-9b88-067cae100873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec2f708-1139-4063-9b88-067cae100873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6001e95-873d-43ec-b4b8-a1f46c107d07', 'volume_name': 'volume-a6001e95-873d-43ec-b4b8-a1f46c107d07', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae23bc75-dad8-44e0-ae07-100fe7942647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae23bc75-dad8-44e0-ae07-100fe7942647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d265ba60-e787-442b-8cfd-5ca23646be36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:24 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Volume a6001e95-873d-43ec-b4b8-a1f46c107d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6001e95-873d-43ec-b4b8-a1f46c107d07', 'volume_size': 1} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f62543ba-8a20-40c0-9c5b-9bbd381e778a,created_at=2026-07-24T13:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2070709316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f62543ba-8a20-40c0-9c5b-9bbd381e778a,host='devstack@QuobyteHD#QuobyteHD',id=a6001e95-873d-43ec-b4b8-a1f46c107d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce77570ad89148599d999070f114268b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:24Z,use_quota=True,user_id='f1f8d45b6aad486eb74686d2f6345c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0578be87-2b86-4070-b8a2-3fb1a7cb4d69),volume_type_id=0578be87-2b86-4070-b8a2-3fb1a7cb4d69)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Creating volume a6001e95-873d-43ec-b4b8-a1f46c107d07 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:24 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:24 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 1073741824 Jul 24 15:48:24 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:24 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec" returned: 0 in 0.573s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:24 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec Jul 24 15:48:24 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:25 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0b9db90-db80-4617-8573-36d6f3c31aec" returned: 0 in 0.427s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-quobyte-c0b9db90-db80-4617-8573-36d6f3c31aec" released by "delete_volume" :: held 1.076s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Created reservations ['97a58ee4-d69c-446f-9171-4db1072d9ee9', '36a93ccc-ce91-4535-8850-9737ce3d32c0', 'bc261e50-f53f-46df-8076-69777329a1e4', '8b314622-0658-4e0b-a96f-908a2cc01bca'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:25 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 1073741824" returned: 0 in 0.859s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:25 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:25 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:25 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 Jul 24 15:48:25 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:25 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.380s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Deleted volume successfully. Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3c1168b-b66a-4024-9f03-ee3dfa5cc809 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-c0b9db90-db80-4617-8573-36d6f3c31aec-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:25 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d265ba60-e787-442b-8cfd-5ca23646be36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6001e95-873d-43ec-b4b8-a1f46c107d07', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20546ba6-ff7e-4183-a982-28170ec445ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Volume volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 (a6001e95-873d-43ec-b4b8-a1f46c107d07): created successfully Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20546ba6-ff7e-4183-a982-28170ec445ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Flow 'volume_create_manager' (845cbaa4-f767-414d-b86d-0681e2136c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8bd54c15-15c4-4a26-b0e4-c4b4e1b23cde tempest-GroupSnapshotsTest-819794554 None] Created volume successfully. Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "cinder-1cbf808d-8819-41bf-8c16-0dbabc9fff70-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-1cbf808d-8819-41bf-8c16-0dbabc9fff70-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "cinder-quobyte-1cbf808d-8819-41bf-8c16-0dbabc9fff70" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-quobyte-1cbf808d-8819-41bf-8c16-0dbabc9fff70" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[568a7a93-f1cd-4436-8fe5-e466764dedd1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:26 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 Jul 24 15:48:26 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:27 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70" returned: 0 in 0.510s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:27 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70 Jul 24 15:48:27 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fb24f63a-d522-4610-ad1c-2ace57b8b37d tempest-GroupSnapshotsTest-819794554 None] Update group completed successfully. Jul 24 15:48:27 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cbf808d-8819-41bf-8c16-0dbabc9fff70" returned: 0 in 0.407s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-quobyte-1cbf808d-8819-41bf-8c16-0dbabc9fff70" released by "delete_volume" :: held 0.998s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Created reservations ['f11b1e61-2f75-4eab-ad4e-e5ca73ad8c73', '8ce3b9c3-e2ca-41f6-bcd2-1b8ec2a2fd4e', 'a210391f-a5bd-487b-aa38-02ca0ecfd740', '7cda2b2b-07ac-401e-8416-492519ab8094'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:27 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:27 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:28 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.329s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:28 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Deleted volume successfully. Jul 24 15:48:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c630af94-8aa3-436f-874e-c85dbeb556d2 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-1cbf808d-8819-41bf-8c16-0dbabc9fff70-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c317494a-88e9-4478-b292-814bc27e1e4d tempest-GroupSnapshotsTest-819794554 None] Update group completed successfully. Jul 24 15:48:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "cinder-a6a3d2d4-2823-43d6-866a-324c22cace97-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-a6a3d2d4-2823-43d6-866a-324c22cace97-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "cinder-quobyte-a6a3d2d4-2823-43d6-866a-324c22cace97" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-quobyte-a6a3d2d4-2823-43d6-866a-324c22cace97" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:29 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0bdac0-6fee-4b20-b5f3-a2140bb26f4e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:29 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 Jul 24 15:48:29 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:29 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97" returned: 0 in 0.380s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:29 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97 Jul 24 15:48:29 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-181bc6ae-db9f-4434-b385-1a5e37d31879 tempest-GroupSnapshotsTest-819794554 None] Update group completed successfully. Jul 24 15:48:30 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6a3d2d4-2823-43d6-866a-324c22cace97" returned: 0 in 0.307s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-quobyte-a6a3d2d4-2823-43d6-866a-324c22cace97" released by "delete_volume" :: held 0.729s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Created reservations ['1bec6455-a260-4c66-a26f-195b60ddd81c', '5c0e9473-03c7-4805-85b2-0606a94ab47d', 'e5d363ec-a885-4258-b461-6e98245c184e', 'fb34e514-3641-491c-aef2-abf5490de619'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:30 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:30 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:30 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.375s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Deleted volume successfully. Jul 24 15:48:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a972fb14-9934-4ad8-8f66-06ebe9187f77 tempest-AttachVolumeNegativeTest-553811594 None] Lock "cinder-a6a3d2d4-2823-43d6-866a-324c22cace97-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-82879693-7078-49c9-87ff-9ad51859db03 tempest-GroupSnapshotsTest-819794554 None] Update group completed successfully. Jul 24 15:48:33 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] GroupSnapshot 70a37f51-cf3f-4bc0-942e-b39fa84a83ff: creating. Jul 24 15:48:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Group snapshot 70a37f51-cf3f-4bc0-942e-b39fa84a83ff: creating. {{(pid=88251) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 15:48:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Creating offline snapshot 2fc8cdbe-1564-4049-b85b-9896216d6716 of volume 2d01440f-afd9-41b4-93a5-b9765bdb94dd {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:48:33 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a61cdbc-da47-41a5-9bd5-5b70f8109be6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:33 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd Jul 24 15:48:33 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:33 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd" returned: 0 in 0.669s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:33 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 1G Jul 24 15:48:33 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:34 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 1G" returned: 0 in 0.827s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:34 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 Jul 24 15:48:34 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:34 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:34 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:35 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.404s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:35 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 28 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716" returned: 0 in 0.519s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:35 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:35 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 Jul 24 15:48:35 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:35 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716" returned: 0 in 0.437s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=124,cinder:DELETE=8,cinder:SELECT=115,cinder:INSERT=26 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=99,cinder:UPDATE=118,cinder:DELETE=7,cinder:INSERT=27 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:48:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:35 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.info Jul 24 15:48:35 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:36 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.info" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:36 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:36 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.info Jul 24 15:48:36 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:36 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.info" returned: 0 in 0.329s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Creating offline snapshot b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e of volume a6001e95-873d-43ec-b4b8-a1f46c107d07 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ef2dd1-b4e1-429a-91e6-7b51699846dd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:36 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 Jul 24 15:48:36 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:36 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07" returned: 0 in 0.488s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:36 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e 1G Jul 24 15:48:36 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:37 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e 1G" returned: 0 in 0.543s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:37 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e Jul 24 15:48:37 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:37 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e" returned: 0 in 0.409s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:37 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:48:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:37 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e Jul 24 15:48:37 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:38 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:38 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.info Jul 24 15:48:38 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:38 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.info" returned: 0 in 0.322s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:38 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:48:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:38 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.info Jul 24 15:48:38 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:38 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.info" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:39 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3e1b46fe-c732-4fc1-92ff-63668b8b4da3 tempest-GroupSnapshotsTest-819794554 None] group_snapshot 70a37f51-cf3f-4bc0-942e-b39fa84a83ff: created successfully Jul 24 15:48:39 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] group_snapshot 70a37f51-cf3f-4bc0-942e-b39fa84a83ff: deleting Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] group_snapshot 70a37f51-cf3f-4bc0-942e-b39fa84a83ff: deleting {{(pid=88251) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-2d01440f-afd9-41b4-93a5-b9765bdb94dd" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-2d01440f-afd9-41b4-93a5-b9765bdb94dd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-2fc8cdbe-1564-4049-b85b-9896216d6716" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-2fc8cdbe-1564-4049-b85b-9896216d6716" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Deleting offline snapshot 2fc8cdbe-1564-4049-b85b-9896216d6716 of volume 2d01440f-afd9-41b4-93a5-b9765bdb94dd {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] snapshot_file for this snap is: volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe30f34a-d731-407c-99f2-fbd79e0a5a72]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:39 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 Jul 24 15:48:39 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:40 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716" returned: 0 in 0.492s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc742112-b030-4340-b680-f7a8413fec5a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (db1758bb-a573-4a1d-947a-713b2245d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910be1b9-8cc9-45ff-8e8a-36051da8a060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910be1b9-8cc9-45ff-8e8a-36051da8a060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-823100216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d749902-36e9-4191-b5f7-fa9b24c91152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3b63a77144442e9f809189a0ff8779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:40Z,use_quota=True,user_id='d8feb74c3cd84b7baf5ca226731d12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:40 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd Jul 24 15:48:40 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf45e0cf-71f7-4b58-b736-bbffecdf3881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf45e0cf-71f7-4b58-b736-bbffecdf3881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa393e6d-05b7-4266-88e5-c11d7a57a46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa393e6d-05b7-4266-88e5-c11d7a57a46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d749902-36e9-4191-b5f7-fa9b24c91152', 'volume_name': 'volume-1d749902-36e9-4191-b5f7-fa9b24c91152', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d772049-749c-495d-994d-d11513a02e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d772049-749c-495d-994d-d11513a02e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f73e710-4b16-4a4b-bea9-b0707ae294fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:40 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume 1d749902-36e9-4191-b5f7-fa9b24c91152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d749902-36e9-4191-b5f7-fa9b24c91152', 'volume_size': 1} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-823100216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d749902-36e9-4191-b5f7-fa9b24c91152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3b63a77144442e9f809189a0ff8779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:40Z,use_quota=True,user_id='d8feb74c3cd84b7baf5ca226731d12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Creating volume 1d749902-36e9-4191-b5f7-fa9b24c91152 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:40 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:40 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 1073741824 Jul 24 15:48:40 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:40 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd" returned: 0 in 0.423s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:40 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 Jul 24 15:48:40 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Flow 'volume_create_manager' (35a8777c-0dca-4dbc-9912-b9af2844174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867cdce-2dd1-46c4-ba22-8e9e070a7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867cdce-2dd1-46c4-ba22-8e9e070a7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1510151709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='953676e1cd874abd8d0a925acd1223c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:41Z,use_quota=True,user_id='2b26c4f22e8447e8898e4d6f0cc648bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:41 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1989021b-ae00-4454-ae52-7b0a1519b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1989021b-ae00-4454-ae52-7b0a1519b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1012adca-30cd-4cb2-8612-6a5ff6685377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1012adca-30cd-4cb2-8612-6a5ff6685377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4', 'volume_name': 'volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ecac50-497c-486f-8c00-541e99e1e2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ecac50-497c-486f-8c00-541e99e1e2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8380507-e30c-43a1-923b-27c6745d1ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Volume b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4', 'volume_size': 1} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 1073741824" returned: 0 in 0.550s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:41 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 Jul 24 15:48:41 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:41 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716" returned: 0 in 0.420s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:41 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716 Jul 24 15:48:41 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:41 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152" returned: 0 in 0.281s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1510151709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='953676e1cd874abd8d0a925acd1223c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:41Z,use_quota=True,user_id='2b26c4f22e8447e8898e4d6f0cc648bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Creating volume b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:41 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f73e710-4b16-4a4b-bea9-b0707ae294fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d749902-36e9-4191-b5f7-fa9b24c91152', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31897954-1c68-4d55-8662-81a6bb404580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:41 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 1073741824 Jul 24 15:48:41 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume volume-1d749902-36e9-4191-b5f7-fa9b24c91152 (1d749902-36e9-4191-b5f7-fa9b24c91152): created successfully Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31897954-1c68-4d55-8662-81a6bb404580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:41 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (db1758bb-a573-4a1d-947a-713b2245d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd.2fc8cdbe-1564-4049-b85b-9896216d6716" returned: 0 in 0.281s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-2fc8cdbe-1564-4049-b85b-9896216d6716" released by "_delete_snapshot" :: held 1.772s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-2d01440f-afd9-41b4-93a5-b9765bdb94dd" released by "delete_snapshot" :: held 1.805s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1ea87360-27e7-43f0-9869-64ba79fa97b0 tempest-VolumesSnapshotTestJSON-1693284829 None] Created volume successfully. Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-a6001e95-873d-43ec-b4b8-a1f46c107d07" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-a6001e95-873d-43ec-b4b8-a1f46c107d07" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Deleting offline snapshot b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e of volume a6001e95-873d-43ec-b4b8-a1f46c107d07 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] snapshot_file for this snap is: volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e3aa02-6dad-4ad1-8d33-df44fe42eba2]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:41 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e Jul 24 15:48:41 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:41 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 1073741824" returned: 0 in 0.489s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:42 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 Jul 24 15:48:42 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:42 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e" returned: 0 in 0.408s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6001e95-873d-43ec-b4b8-a1f46c107d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[331d5d5d-135b-4c37-9b54-c325275b34a4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:42 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4" returned: 0 in 0.277s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:42 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 Jul 24 15:48:42 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8380507-e30c-43a1-923b-27c6745d1ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857517a9-9c82-4656-9402-52b5e00fccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:42 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Volume volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 (b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4): created successfully Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857517a9-9c82-4656-9402-52b5e00fccf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Flow 'volume_create_manager' (35a8777c-0dca-4dbc-9912-b9af2844174d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-977b1847-dca3-4a08-b43b-f4002ce12f86 tempest-VolumesTestJSON-1832127692 None] Created volume successfully. Jul 24 15:48:42 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07" returned: 0 in 0.477s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:42 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e Jul 24 15:48:42 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Creating offline snapshot 46ff18c7-c71e-41f7-a9fd-33b2adebd001 of volume 1d749902-36e9-4191-b5f7-fa9b24c91152 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2235d58a-2c61-4472-8e4b-cbb072da43f1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:42 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e" returned: 0 in 0.384s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:43 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 Jul 24 15:48:43 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:43 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e Jul 24 15:48:43 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:43 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07.b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e" returned: 0 in 0.314s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-b24cd6c5-3988-4eb5-8e8d-1fa8d0c0be3e" released by "_delete_snapshot" :: held 1.732s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:43 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152" returned: 0 in 0.488s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-a6001e95-873d-43ec-b4b8-a1f46c107d07" released by "delete_snapshot" :: held 1.773s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:43 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 1G Jul 24 15:48:43 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:43 devstack cinder-volume[88251]: WARNING cinder.quota [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2136504251 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2136504251, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:48:43 devstack cinder-volume[88251]: WARNING cinder.quota [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2136504251 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2136504251, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Created reservations ['c7aed2fa-942f-4f0b-8bcd-e54706cf7146', '1caafede-cd64-4ac6-9232-53b0666e9713', '2ad0ece8-3553-4d7e-8104-b7906f2de28b', '63d5c6d2-82eb-45a3-afdc-7ec74ef97e00'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] Created reservations ['4aee27c8-cd9c-45ef-9bb5-065bc3f103d2', '87bc6d8e-639c-48c1-aeb7-43d0a24b4077', '0b14f0a9-d415-4d0e-bf9e-067555ac29b5', '48d42d46-ab8b-4902-bf13-7907a18bf4fe'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Flow 'volume_create_manager' (12564fc3-b3c1-4156-af49-7493389842ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e661990-54fe-45fb-8e97-af1af266c85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e661990-54fe-45fb-8e97-af1af266c85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1602296694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed8a34b-1123-4fb4-a42d-14d0efa4b678,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='953676e1cd874abd8d0a925acd1223c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:44Z,use_quota=True,user_id='2b26c4f22e8447e8898e4d6f0cc648bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a846c85f-06bb-493d-87d1-a1cc8c1da1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a846c85f-06bb-493d-87d1-a1cc8c1da1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750c87fa-8844-40a6-b5a3-3f8b855f8f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750c87fa-8844-40a6-b5a3-3f8b855f8f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed8a34b-1123-4fb4-a42d-14d0efa4b678', 'volume_name': 'volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307cedde-46fc-4804-ac28-4e0a56fa1dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307cedde-46fc-4804-ac28-4e0a56fa1dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cd0cd3-681d-461f-8a14-c42eb2401dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:43 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Volume 8ed8a34b-1123-4fb4-a42d-14d0efa4b678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678', 'volume_size': 1} Jul 24 15:48:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:43 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b69e8b48-5dfa-4733-bd67-8cb240b1969e tempest-GroupSnapshotsTest-819794554 None] group_snapshot 70a37f51-cf3f-4bc0-942e-b39fa84a83ff: deleted successfully Jul 24 15:48:43 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 1G" returned: 0 in 0.634s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d749902-36e9-4191-b5f7-fa9b24c91152 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:44 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d749902-36e9-4191-b5f7-fa9b24c91152 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 Jul 24 15:48:44 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:44 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d749902-36e9-4191-b5f7-fa9b24c91152 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001" returned: 0 in 0.346s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:44 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 is being set with open permissions: ugo+rw Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:44 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 Jul 24 15:48:44 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:44 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001" returned: 0 in 0.346s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-2d01440f-afd9-41b4-93a5-b9765bdb94dd" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-2d01440f-afd9-41b4-93a5-b9765bdb94dd" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bff14bf-b7a6-42bb-8138-aaf05a79c83b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:44 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.info Jul 24 15:48:44 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:44 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd Jul 24 15:48:44 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:45 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.info" returned: 0 in 0.252s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:45 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.info is being set with open permissions: ugo+rw Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:45 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.info Jul 24 15:48:45 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:45 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd" returned: 0 in 0.407s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:45 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd Jul 24 15:48:45 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:45 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.info" returned: 0 in 0.251s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1602296694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed8a34b-1123-4fb4-a42d-14d0efa4b678,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='953676e1cd874abd8d0a925acd1223c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:44Z,use_quota=True,user_id='2b26c4f22e8447e8898e4d6f0cc648bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Creating volume 8ed8a34b-1123-4fb4-a42d-14d0efa4b678 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:45 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:45 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 1073741824 Jul 24 15:48:45 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-04a8d33a-8486-412f-ae9b-01d3722256db tempest-VolumesSnapshotTestJSON-1693284829 None] Create snapshot completed successfully Jul 24 15:48:45 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d01440f-afd9-41b4-93a5-b9765bdb94dd" returned: 0 in 0.281s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-2d01440f-afd9-41b4-93a5-b9765bdb94dd" released by "delete_volume" :: held 0.771s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-a6001e95-873d-43ec-b4b8-a1f46c107d07" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-a6001e95-873d-43ec-b4b8-a1f46c107d07" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d29f6b-8785-4574-80d9-c59b7b3d2891]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:45 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 Jul 24 15:48:45 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:45 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 1073741824" returned: 0 in 0.459s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:45 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 Jul 24 15:48:45 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:45 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07" returned: 0 in 0.425s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:46 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07 Jul 24 15:48:46 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:46 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cd0cd3-681d-461f-8a14-c42eb2401dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90355ebe-1d59-4e4a-9dbe-ec3cfb7f2e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:46 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Volume volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 (8ed8a34b-1123-4fb4-a42d-14d0efa4b678): created successfully Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90355ebe-1d59-4e4a-9dbe-ec3cfb7f2e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Flow 'volume_create_manager' (12564fc3-b3c1-4156-af49-7493389842ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-46ff18c7-c71e-41f7-a9fd-33b2adebd001-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-98761763-f786-4ec5-bfef-3ed3d6452065 tempest-VolumesTestJSON-1832127692 None] Created volume successfully. Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-46ff18c7-c71e-41f7-a9fd-33b2adebd001-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-1d749902-36e9-4191-b5f7-fa9b24c91152" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-1d749902-36e9-4191-b5f7-fa9b24c91152" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-46ff18c7-c71e-41f7-a9fd-33b2adebd001" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-46ff18c7-c71e-41f7-a9fd-33b2adebd001" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Deleting offline snapshot 46ff18c7-c71e-41f7-a9fd-33b2adebd001 of volume 1d749902-36e9-4191-b5f7-fa9b24c91152 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] snapshot_file for this snap is: volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:48:46 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a6001e95-873d-43ec-b4b8-a1f46c107d07" returned: 0 in 0.295s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d8e887-0831-4f26-b107-3e5844fce45c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-a6001e95-873d-43ec-b4b8-a1f46c107d07" released by "delete_volume" :: held 0.797s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Created reservations ['ec5d80dd-33b8-4428-b2b3-ad1061b24161'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:46 devstack cinder-volume[88251]: WARNING cinder.quota [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2136504251 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2136504251, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:48:46 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 Jul 24 15:48:46 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Created reservations ['ced65340-e8c2-480b-9c8e-070b96c60546', 'abcc2fa9-6ba4-4bdd-8853-3b0bca937212', 'afd882cf-68b1-453a-b5ee-082eab5a5e6c', '40ede981-f808-44f7-9ef8-743cf463f24e'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Created reservations ['b48ceeeb-626c-4574-8008-efb643ecb4fa', '0666b86b-7803-429e-ab79-5bbf38fc3f65', '4679fe33-24d1-4028-a1e9-0942b1541f64', 'b4fd867a-8fa4-4680-a9bc-bdc71b6056c5'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:46 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:46 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:46 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001" returned: 0 in 0.408s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d749902-36e9-4191-b5f7-fa9b24c91152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7b1412-a95a-4efc-ac55-9a2dd2d79d80]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:46 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 Jul 24 15:48:46 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:46 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:46 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9de92ca1-6e18-4873-8589-3dd06313a22e tempest-GroupSnapshotsTest-819794554 None] Delete group completed successfully. Jul 24 15:48:47 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152" returned: 0 in 0.447s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:47 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 Jul 24 15:48:47 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:47 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001" returned: 0 in 0.493s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:47 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001 Jul 24 15:48:47 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Flow 'volume_create_manager' (d5f03e33-246b-4fc9-9532-2244a89e0b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05d9105-304d-4b40-ac92-a44f3d3469e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05d9105-304d-4b40-ac92-a44f3d3469e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1630544485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee7df39-0de8-4abe-834a-a3c1f8fad903,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='953676e1cd874abd8d0a925acd1223c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:48Z,use_quota=True,user_id='2b26c4f22e8447e8898e4d6f0cc648bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b57994-4b77-4262-8f48-6747960a10da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b57994-4b77-4262-8f48-6747960a10da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a460111b-5681-4962-8095-c6db4fed2382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a460111b-5681-4962-8095-c6db4fed2382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee7df39-0de8-4abe-834a-a3c1f8fad903', 'volume_name': 'volume-bee7df39-0de8-4abe-834a-a3c1f8fad903', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5603c5e6-8525-4d65-91b2-22d9290eefe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5603c5e6-8525-4d65-91b2-22d9290eefe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5ab58b-e627-4707-bea5-d7dc3c5fb1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Volume bee7df39-0de8-4abe-834a-a3c1f8fad903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee7df39-0de8-4abe-834a-a3c1f8fad903', 'volume_size': 1} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1630544485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee7df39-0de8-4abe-834a-a3c1f8fad903,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='953676e1cd874abd8d0a925acd1223c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:48Z,use_quota=True,user_id='2b26c4f22e8447e8898e4d6f0cc648bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Creating volume bee7df39-0de8-4abe-834a-a3c1f8fad903 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:47 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:47 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8b56f03f-a5e7-4a2f-b368-40a17f326e49 tempest-GroupSnapshotsTest-819794554 None] Group tempest-GroupSnapshotsTest-Group-2093226839: creating Jul 24 15:48:47 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 1073741824 Jul 24 15:48:48 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8b56f03f-a5e7-4a2f-b368-40a17f326e49 tempest-GroupSnapshotsTest-819794554 None] Group tempest-GroupSnapshotsTest-Group-2093226839: created successfully Jul 24 15:48:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8b56f03f-a5e7-4a2f-b368-40a17f326e49 tempest-GroupSnapshotsTest-819794554 None] Create group completed successfully. Jul 24 15:48:48 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152.46ff18c7-c71e-41f7-a9fd-33b2adebd001" returned: 0 in 0.397s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-46ff18c7-c71e-41f7-a9fd-33b2adebd001" released by "_delete_snapshot" :: held 1.867s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-1d749902-36e9-4191-b5f7-fa9b24c91152" released by "delete_snapshot" :: held 1.892s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Created reservations ['d747bf50-f80a-4029-9993-fcf6c853359f', '1350ea33-0c82-4e21-9270-cb26b7ef7821', 'c9c97212-44dc-46ca-b1fd-4497b5efc719', '241f30d4-8afb-4144-b0bb-6d874f23a87d'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Delete snapshot completed successfully. Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-910a2b12-4e22-4b01-9bba-f4f6fb424e6f tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-46ff18c7-c71e-41f7-a9fd-33b2adebd001-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Flow 'volume_create_manager' (f1b1ef94-2e23-4d37-8932-9e5f087736b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34c080f-684e-4dcf-aa7c-1f76d75f97ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34c080f-684e-4dcf-aa7c-1f76d75f97ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-434688935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da41fabf-f41d-4e6d-bd78-8a3423144947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddd457719764fa4ad5d5a2a79f8e243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:48Z,use_quota=True,user_id='9f50127fffe84f2794412d1601ab96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f60c37f-a8b0-4f33-9b71-25405a7cbc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f60c37f-a8b0-4f33-9b71-25405a7cbc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04618119-fa0b-4495-9d80-4e30b2cc1353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04618119-fa0b-4495-9d80-4e30b2cc1353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da41fabf-f41d-4e6d-bd78-8a3423144947', 'volume_name': 'volume-da41fabf-f41d-4e6d-bd78-8a3423144947', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86563a5-5a20-4ef2-9c04-e69329d7228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86563a5-5a20-4ef2-9c04-e69329d7228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f39dde0-1d9e-47e4-983a-a793d643a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:48 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Volume da41fabf-f41d-4e6d-bd78-8a3423144947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da41fabf-f41d-4e6d-bd78-8a3423144947', 'volume_size': 1} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:48 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 1073741824" returned: 0 in 0.614s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:48 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 Jul 24 15:48:48 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:48 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903" returned: 0 in 0.355s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-434688935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da41fabf-f41d-4e6d-bd78-8a3423144947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddd457719764fa4ad5d5a2a79f8e243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:48Z,use_quota=True,user_id='9f50127fffe84f2794412d1601ab96f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Creating volume da41fabf-f41d-4e6d-bd78-8a3423144947 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:48 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5ab58b-e627-4707-bea5-d7dc3c5fb1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee7df39-0de8-4abe-834a-a3c1f8fad903', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6294d0d5-512c-4f39-a1ba-87645f6038be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 1073741824 Jul 24 15:48:49 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Volume volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 (bee7df39-0de8-4abe-834a-a3c1f8fad903): created successfully Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6294d0d5-512c-4f39-a1ba-87645f6038be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Flow 'volume_create_manager' (d5f03e33-246b-4fc9-9532-2244a89e0b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-818780cb-a00d-4c6b-935c-01d7cda08bf3 tempest-VolumesTestJSON-1832127692 None] Created volume successfully. Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (d59d8275-cf35-4a78-b87b-e631efd694ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7183ac-3618-48c0-b980-170a438f6e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7183ac-3618-48c0-b980-170a438f6e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-286308364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92185d44-7d25-4127-ae97-66c3f9dd844a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3b63a77144442e9f809189a0ff8779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:49Z,use_quota=True,user_id='d8feb74c3cd84b7baf5ca226731d12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c266a99c-0cdb-4913-8b32-797e05538bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c266a99c-0cdb-4913-8b32-797e05538bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151c27fb-e919-4181-a866-0543b6df2706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151c27fb-e919-4181-a866-0543b6df2706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92185d44-7d25-4127-ae97-66c3f9dd844a', 'volume_name': 'volume-92185d44-7d25-4127-ae97-66c3f9dd844a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5ba575-973c-4f60-8c7d-a5b33a66864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5ba575-973c-4f60-8c7d-a5b33a66864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbde2b9a-50b2-4a6e-b1a4-0b2468878b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume 92185d44-7d25-4127-ae97-66c3f9dd844a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92185d44-7d25-4127-ae97-66c3f9dd844a', 'volume_size': 1} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:49 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 1073741824" returned: 0 in 0.507s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Flow 'volume_create_manager' (eaec5fd7-f06a-4331-bffb-71fc43f1f259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806f01f6-e258-4a4c-b666-de798892084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806f01f6-e258-4a4c-b666-de798892084a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395542227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=936878ba-7c5a-4d95-997f-c90234413077,host='devstack@QuobyteHD#QuobyteHD',id=23d300da-f79a-47f1-9b36-2e3c67339a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce77570ad89148599d999070f114268b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:49Z,use_quota=True,user_id='f1f8d45b6aad486eb74686d2f6345c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02564a52-8814-4d5f-b7e8-7c83ef84ead4),volume_type_id=02564a52-8814-4d5f-b7e8-7c83ef84ead4)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cd7059-c8ce-47f6-8fb2-f2173e74e2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cd7059-c8ce-47f6-8fb2-f2173e74e2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6f2ff7-3a4a-43af-8982-1ff5d6add2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6f2ff7-3a4a-43af-8982-1ff5d6add2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d300da-f79a-47f1-9b36-2e3c67339a80', 'volume_name': 'volume-23d300da-f79a-47f1-9b36-2e3c67339a80', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f454b2-7f2f-4a23-8ad0-d0634ec79a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f454b2-7f2f-4a23-8ad0-d0634ec79a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55768000-34cf-4210-8b79-237fc42b542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Volume 23d300da-f79a-47f1-9b36-2e3c67339a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d300da-f79a-47f1-9b36-2e3c67339a80', 'volume_size': 1} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:49 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 Jul 24 15:48:49 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:49 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947" returned: 0 in 0.253s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-286308364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92185d44-7d25-4127-ae97-66c3f9dd844a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3b63a77144442e9f809189a0ff8779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:49Z,use_quota=True,user_id='d8feb74c3cd84b7baf5ca226731d12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Creating volume 92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:49 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f39dde0-1d9e-47e4-983a-a793d643a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da41fabf-f41d-4e6d-bd78-8a3423144947', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c35d4af-e7a4-4d71-8499-41eb4050c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:49 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a 1073741824 Jul 24 15:48:49 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Volume volume-da41fabf-f41d-4e6d-bd78-8a3423144947 (da41fabf-f41d-4e6d-bd78-8a3423144947): created successfully Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c35d4af-e7a4-4d71-8499-41eb4050c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Flow 'volume_create_manager' (f1b1ef94-2e23-4d37-8932-9e5f087736b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b11d9daa-b02b-4046-a1a5-90f7dc417b35 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Created volume successfully. Jul 24 15:48:50 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a 1073741824" returned: 0 in 0.512s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:50 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a Jul 24 15:48:50 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:50 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a" returned: 0 in 0.290s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=936878ba-7c5a-4d95-997f-c90234413077,created_at=2026-07-24T13:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395542227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=936878ba-7c5a-4d95-997f-c90234413077,host='devstack@QuobyteHD#QuobyteHD',id=23d300da-f79a-47f1-9b36-2e3c67339a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce77570ad89148599d999070f114268b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:49Z,use_quota=True,user_id='f1f8d45b6aad486eb74686d2f6345c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02564a52-8814-4d5f-b7e8-7c83ef84ead4),volume_type_id=02564a52-8814-4d5f-b7e8-7c83ef84ead4)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Creating volume 23d300da-f79a-47f1-9b36-2e3c67339a80 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:50 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "cinder-bee7df39-0de8-4abe-834a-a3c1f8fad903-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:50 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 1073741824 Jul 24 15:48:50 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbde2b9a-50b2-4a6e-b1a4-0b2468878b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92185d44-7d25-4127-ae97-66c3f9dd844a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482fb33c-1d94-464e-bd8a-d9ce515bc330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-bee7df39-0de8-4abe-834a-a3c1f8fad903-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume volume-92185d44-7d25-4127-ae97-66c3f9dd844a (92185d44-7d25-4127-ae97-66c3f9dd844a): created successfully Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482fb33c-1d94-464e-bd8a-d9ce515bc330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (d59d8275-cf35-4a78-b87b-e631efd694ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fca13024-a962-447a-892c-24443c79bb11 tempest-VolumesSnapshotTestJSON-1693284829 None] Created volume successfully. Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "cinder-quobyte-bee7df39-0de8-4abe-834a-a3c1f8fad903" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-quobyte-bee7df39-0de8-4abe-834a-a3c1f8fad903" acquired by "delete_volume" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ee696-cc25-472f-aff5-4105c1496d59]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:51 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 Jul 24 15:48:51 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:51 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 1073741824" returned: 0 in 0.554s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:51 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 Jul 24 15:48:51 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4a9fb652-04ee-4124-afc4-9a2b27a3a98a req-3486eb32-0774-4783-a002-c2f5c2fb3f5f tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:51 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903" returned: 0 in 0.538s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:51 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903 Jul 24 15:48:51 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:51 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.161s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Creating offline snapshot 15e3dcd4-cb37-4be8-b033-bddefef3bdca of volume 92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55768000-34cf-4210-8b79-237fc42b542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d300da-f79a-47f1-9b36-2e3c67339a80', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7490623e-b115-4aea-ac9c-a2e0db3c5ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be708c3-bfa6-4a98-9914-a414b5c48680]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Volume volume-23d300da-f79a-47f1-9b36-2e3c67339a80 (23d300da-f79a-47f1-9b36-2e3c67339a80): created successfully Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7490623e-b115-4aea-ac9c-a2e0db3c5ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Flow 'volume_create_manager' (eaec5fd7-f06a-4331-bffb-71fc43f1f259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fa37035c-c4c5-4df6-963e-b21d100cf742 tempest-GroupSnapshotsTest-819794554 None] Created volume successfully. Jul 24 15:48:51 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bee7df39-0de8-4abe-834a-a3c1f8fad903" returned: 0 in 0.276s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-quobyte-bee7df39-0de8-4abe-834a-a3c1f8fad903" released by "delete_volume" :: held 0.868s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:51 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a Jul 24 15:48:51 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Created reservations ['4bdb1ab7-4db7-45a8-a435-6506f7a4c0c1', 'eb207a82-6ce2-4d9f-8ab1-6f435b37d281', '3dc0c79b-9876-42fb-92a6-3ee125474f1d', '47999412-7f02-42ac-a5e0-0951d9f805c4'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:51 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:51 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:52 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a" returned: 0 in 0.422s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:52 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca 1G Jul 24 15:48:52 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] GroupSnapshot e66b8c56-ea65-4872-bad8-79de0c296f83: creating. Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Group snapshot e66b8c56-ea65-4872-bad8-79de0c296f83: creating. {{(pid=88251) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "cinder-8ed8a34b-1123-4fb4-a42d-14d0efa4b678-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:52 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.312s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-8ed8a34b-1123-4fb4-a42d-14d0efa4b678-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Deleted volume successfully. Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92e484bd-ebac-4cb3-bafa-b5348dfcc204 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-bee7df39-0de8-4abe-834a-a3c1f8fad903-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "cinder-quobyte-8ed8a34b-1123-4fb4-a42d-14d0efa4b678" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-quobyte-8ed8a34b-1123-4fb4-a42d-14d0efa4b678" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eab98e7-2883-4a46-8905-e50ed88d1818]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:52 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 Jul 24 15:48:52 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:52 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca 1G" returned: 0 in 0.465s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92185d44-7d25-4127-ae97-66c3f9dd844a -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:52 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92185d44-7d25-4127-ae97-66c3f9dd844a -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca Jul 24 15:48:52 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:52 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678" returned: 0 in 0.393s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:52 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678 Jul 24 15:48:52 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:52 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92185d44-7d25-4127-ae97-66c3f9dd844a -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca" returned: 0 in 0.300s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:52 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca is being set with open permissions: ugo+rw Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:52 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca Jul 24 15:48:52 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:52 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8ed8a34b-1123-4fb4-a42d-14d0efa4b678" returned: 0 in 0.256s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-quobyte-8ed8a34b-1123-4fb4-a42d-14d0efa4b678" released by "delete_volume" :: held 0.704s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Created reservations ['2bdace39-d96f-414a-9b61-6ef077fa5034', 'a3b53d98-1141-4932-b3cc-803ed41943cb', 'f1b741a6-31ad-4a1d-b55d-b6201240df03', 'c8fd974b-e41f-4442-8f0a-56a07d00575a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:53 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca" returned: 0 in 0.282s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:53 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:53 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:53 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.info Jul 24 15:48:53 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:53 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Deleted volume successfully. Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d8fd0e90-f491-44bb-a99f-a03931aecc42 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-8ed8a34b-1123-4fb4-a42d-14d0efa4b678-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:53 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.info" returned: 0 in 0.290s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:53 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.info is being set with open permissions: ugo+rw Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "cinder-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:53 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.info Jul 24 15:48:53 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "cinder-quobyte-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-quobyte-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5a357e-fee5-46a1-a8c6-4c5c738fa2af]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:53 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 Jul 24 15:48:53 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:53 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.info" returned: 0 in 0.336s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4a9fb652-04ee-4124-afc4-9a2b27a3a98a req-3486eb32-0774-4783-a002-c2f5c2fb3f5f tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.347s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4a9fb652-04ee-4124-afc4-9a2b27a3a98a req-3486eb32-0774-4783-a002-c2f5c2fb3f5f tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.679s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a0cffe00-56dc-4306-b9aa-bd9f30c40b35 tempest-VolumesSnapshotTestJSON-1693284829 None] Create snapshot completed successfully Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Creating offline snapshot d04c7fb0-778c-44b6-aab5-afc5da367a8f of volume 23d300da-f79a-47f1-9b36-2e3c67339a80 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4a9fb652-04ee-4124-afc4-9a2b27a3a98a req-3486eb32-0774-4783-a002-c2f5c2fb3f5f tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-da41fabf-f41d-4e6d-bd78-8a3423144947', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49636e53-c1bc-43ee-b1b8-ecf44af2b483', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b44b2-9163-4d5b-bf24-0d997776bf75]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:54 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4" returned: 0 in 0.394s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:54 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4 Jul 24 15:48:54 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-4a9fb652-04ee-4124-afc4-9a2b27a3a98a req-3486eb32-0774-4783-a002-c2f5c2fb3f5f tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] attachment_update completed successfully. Jul 24 15:48:54 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 Jul 24 15:48:54 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:54 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-quobyte-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4" released by "delete_volume" :: held 0.716s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Created reservations ['2b0e78e5-976f-44c1-bc26-6b342535512f', '8997719e-e9ca-46ad-9dc7-12f0e20fc255', 'e2a19db1-319d-4a4d-b85e-d28e23988e6b', '327e0153-1bdb-48f7-ae00-8c295b7df40b'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:54 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80" returned: 0 in 0.477s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:54 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f 1G Jul 24 15:48:54 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:54 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:48:54 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:54 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.427s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Deleted volume successfully. Jul 24 15:48:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d9df3e3c-dd86-410b-9fe0-cb075d019bb9 tempest-VolumesTestJSON-1832127692 None] Lock "cinder-b5f8abc5-5cc8-41fd-9459-e4fd8cbc77c4-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:55 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f 1G" returned: 0 in 0.685s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d300da-f79a-47f1-9b36-2e3c67339a80 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:55 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d300da-f79a-47f1-9b36-2e3c67339a80 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f Jul 24 15:48:55 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:55 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (5b8da51b-d861-4782-993d-76ecdb068d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ef27bf-c995-4c29-b6fc-a45b4ec17a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d300da-f79a-47f1-9b36-2e3c67339a80 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f" returned: 0 in 0.564s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:55 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ef27bf-c995-4c29-b6fc-a45b4ec17a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-918230803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42bb30f-9e77-44cd-9573-156e2a394b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3b63a77144442e9f809189a0ff8779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=15e3dcd4-cb37-4be8-b033-bddefef3bdca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:56Z,use_quota=True,user_id='d8feb74c3cd84b7baf5ca226731d12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817b918c-a6c4-4b68-b937-0e4cb29267ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817b918c-a6c4-4b68-b937-0e4cb29267ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:55 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13b3353-fdb3-4238-bad0-6bddf164bc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:55 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13b3353-fdb3-4238-bad0-6bddf164bc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a42bb30f-9e77-44cd-9573-156e2a394b50', 'volume_name': 'volume-a42bb30f-9e77-44cd-9573-156e2a394b50', 'volume_size': 2, 'snapshot_id': '15e3dcd4-cb37-4be8-b033-bddefef3bdca'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0648da17-3536-4b08-a010-b57f8e2bbb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0648da17-3536-4b08-a010-b57f8e2bbb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f38ce6-df43-43b7-8669-de189b228cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:55 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume a42bb30f-9e77-44cd-9573-156e2a394b50: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a42bb30f-9e77-44cd-9573-156e2a394b50', 'volume_size': 2, 'snapshot_id': '15e3dcd4-cb37-4be8-b033-bddefef3bdca'} Jul 24 15:48:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:55 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:56 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.info Jul 24 15:48:56 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:56 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.info" returned: 0 in 0.347s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:56 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:56 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.info Jul 24 15:48:56 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:56 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.info" returned: 0 in 0.328s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.869s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.942s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-15e3dcd4-cb37-4be8-b033-bddefef3bdca-a42bb30f-9e77-44cd-9573-156e2a394b50" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-15e3dcd4-cb37-4be8-b033-bddefef3bdca-a42bb30f-9e77-44cd-9573-156e2a394b50" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Creating volume a42bb30f-9e77-44cd-9573-156e2a394b50 from snapshot 15e3dcd4-cb37-4be8-b033-bddefef3bdca {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-a42bb30f-9e77-44cd-9573-156e2a394b50" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-a42bb30f-9e77-44cd-9573-156e2a394b50" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] snapshot: 15e3dcd4-cb37-4be8-b033-bddefef3bdca, volume: a42bb30f-9e77-44cd-9573-156e2a394b50, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ee05e-07d7-4ce6-aa84-8fa2196a0d2f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-eaa467f1-72aa-4e8a-a2a7-7fb1a2ec161a tempest-GroupSnapshotsTest-819794554 None] group_snapshot e66b8c56-ea65-4872-bad8-79de0c296f83: created successfully Jul 24 15:48:57 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca Jul 24 15:48:57 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:57 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca" returned: 0 in 0.421s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92185d44-7d25-4127-ae97-66c3f9dd844a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b372c8dd-bf36-46f3-a6a0-0f3fb2e56cb6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:57 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a Jul 24 15:48:57 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:57 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] group_snapshot e66b8c56-ea65-4872-bad8-79de0c296f83: deleting Jul 24 15:48:57 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a" returned: 0 in 0.497s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] group_snapshot e66b8c56-ea65-4872-bad8-79de0c296f83: deleting {{(pid=88251) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 15:48:57 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 Jul 24 15:48:57 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:57 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-ac8abddc-2c0c-45e7-83b2-907d97544211 req-6a99ae4c-89d6-430a-b31f-8ce139f79e09 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Terminate volume connection completed successfully. Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-ac8abddc-2c0c-45e7-83b2-907d97544211 req-6a99ae4c-89d6-430a-b31f-8ce139f79e09 tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Deleting attachment 49636e53-c1bc-43ee-b1b8-ecf44af2b483. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-23d300da-f79a-47f1-9b36-2e3c67339a80" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-23d300da-f79a-47f1-9b36-2e3c67339a80" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-d04c7fb0-778c-44b6-aab5-afc5da367a8f" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-d04c7fb0-778c-44b6-aab5-afc5da367a8f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Deleting offline snapshot d04c7fb0-778c-44b6-aab5-afc5da367a8f of volume 23d300da-f79a-47f1-9b36-2e3c67339a80 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] snapshot_file for this snap is: volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed084036-c7fb-49d4-90af-9ba89c0c7456]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:58 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f Jul 24 15:48:58 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:58 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f" returned: 0 in 0.565s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23d300da-f79a-47f1-9b36-2e3c67339a80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:48:58 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba50101-61f4-45e8-ba7d-b6ad1464c9e4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Acquiring lock "cinder-da41fabf-f41d-4e6d-bd78-8a3423144947-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "cinder-da41fabf-f41d-4e6d-bd78-8a3423144947-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:58 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 Jul 24 15:48:58 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Acquiring lock "cinder-quobyte-da41fabf-f41d-4e6d-bd78-8a3423144947" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "cinder-quobyte-da41fabf-f41d-4e6d-bd78-8a3423144947" acquired by "delete_volume" :: waited 0.081s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[357745ab-9bc6-4dc4-926b-baa002a963b1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:59 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 Jul 24 15:48:59 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:59 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80" returned: 0 in 0.841s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:59 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f Jul 24 15:48:59 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:00 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947" returned: 0 in 1.017s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:00 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947 Jul 24 15:49:00 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:00 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f" returned: 0 in 0.932s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:00 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f Jul 24 15:49:00 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:00 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:00 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80.d04c7fb0-778c-44b6-aab5-afc5da367a8f" returned: 0 in 0.490s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da41fabf-f41d-4e6d-bd78-8a3423144947" returned: 0 in 0.828s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-d04c7fb0-778c-44b6-aab5-afc5da367a8f" released by "_delete_snapshot" :: held 3.147s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "cinder-quobyte-da41fabf-f41d-4e6d-bd78-8a3423144947" released by "delete_volume" :: held 1.989s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-23d300da-f79a-47f1-9b36-2e3c67339a80" released by "delete_snapshot" :: held 3.228s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Created reservations ['cbf74471-8e68-40f4-986a-4d5fe6a95724', '846c90cc-44f4-4f9f-9e7f-a1656cefd300', '6452a5c8-d372-4b40-9f57-433b8af646d1', 'd49c1b60-5624-48d0-b5bd-1a9671dcd4ab'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:01 devstack cinder-volume[88251]: WARNING cinder.quota [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-202409618 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-202409618, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:01 devstack cinder-volume[88251]: WARNING cinder.quota [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-202409618 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-202409618, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] Created reservations ['8d91837f-a7a2-4295-a5be-0092d678f50d', 'eb73964c-c469-4ea3-bd91-415f66d2e993', 'ab70e621-96de-4059-995d-c31880a98f32', '53f8889f-6cff-43f8-850f-af555cdb306c'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:01 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:01 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-81443fe8-b8b6-4757-b639-6221758cfbbd tempest-GroupSnapshotsTest-819794554 None] group_snapshot e66b8c56-ea65-4872-bad8-79de0c296f83: deleted successfully Jul 24 15:49:02 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.441s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:02 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:02 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Deleted volume successfully. Jul 24 15:49:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6fb80512-92dd-4583-81a9-9277b423f25d tempest-TestServerVolumeAttachScenarioOldVersion-646156659 None] Lock "cinder-da41fabf-f41d-4e6d-bd78-8a3423144947-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "cinder-quobyte-23d300da-f79a-47f1-9b36-2e3c67339a80" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-23d300da-f79a-47f1-9b36-2e3c67339a80" acquired by "delete_volume" :: waited 0.080s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:03 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb29b24a-2342-4c59-a342-45eea57af612]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:03 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50" returned: 0 in 5.963s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:03 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 Jul 24 15:49:03 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:03 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[881abb95-3d8f-4003-8597-dee2d9a53ae9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:03 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a Jul 24 15:49:03 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:04 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80" returned: 0 in 0.786s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:04 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80 Jul 24 15:49:04 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:04 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-23d300da-f79a-47f1-9b36-2e3c67339a80" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Lock "cinder-quobyte-23d300da-f79a-47f1-9b36-2e3c67339a80" released by "delete_volume" :: held 1.336s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:04 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a" returned: 0 in 0.878s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:49:04 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Converted 1024.00 MB image at 171.64 MB/s Jul 24 15:49:04 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 is being set with open permissions: ugo+rw Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:04 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 Jul 24 15:49:04 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Created reservations ['f9952e60-446e-46aa-a2f8-115d7c2be3c0'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:04 devstack cinder-volume[88251]: WARNING cinder.quota [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-202409618 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-202409618, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:04 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Created reservations ['3cc91bee-2535-4c4c-862d-7da8bbc789ec', '6d47f1cc-d7f9-43ee-b49a-7e597aae25d0', 'c20264f7-063c-4108-aaad-c89b802eb029', '807e506f-9d5b-4f5b-9d9c-2c65dae55924'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:05 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:05 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50" returned: 0 in 0.458s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:05 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-a42bb30f-9e77-44cd-9573-156e2a394b50" released by "_copy_volume_from_snapshot" :: held 8.379s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-15e3dcd4-cb37-4be8-b033-bddefef3bdca-a42bb30f-9e77-44cd-9573-156e2a394b50" released by "_create_volume_from_snapshot" :: held 8.427s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.469s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f38ce6-df43-43b7-8669-de189b228cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a42bb30f-9e77-44cd-9573-156e2a394b50', 'volume_size': 2, 'snapshot_id': '15e3dcd4-cb37-4be8-b033-bddefef3bdca'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac74cb0-596f-4cf2-9eb1-6f30f54f0d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume volume-a42bb30f-9e77-44cd-9573-156e2a394b50 (a42bb30f-9e77-44cd-9573-156e2a394b50): created successfully Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac74cb0-596f-4cf2-9eb1-6f30f54f0d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (5b8da51b-d861-4782-993d-76ecdb068d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-db8f7a95-56f2-4153-b68f-502f0842db79 tempest-VolumesSnapshotTestJSON-1693284829 None] Created volume successfully. Jul 24 15:49:05 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.406s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-50519e23-0e5d-4dae-ad0b-dfdc2ca0f6ec tempest-GroupSnapshotsTest-819794554 None] Delete group completed successfully. Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-a42bb30f-9e77-44cd-9573-156e2a394b50-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-a42bb30f-9e77-44cd-9573-156e2a394b50-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-a42bb30f-9e77-44cd-9573-156e2a394b50" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-a42bb30f-9e77-44cd-9573-156e2a394b50" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[561bf26c-e5fa-4cee-a5e3-5dcb58d22ec4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:06 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 Jul 24 15:49:06 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:06 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50" returned: 0 in 0.438s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:06 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50 Jul 24 15:49:06 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:06 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a42bb30f-9e77-44cd-9573-156e2a394b50" returned: 0 in 0.328s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-a42bb30f-9e77-44cd-9573-156e2a394b50" released by "delete_volume" :: held 0.825s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Created reservations ['89ed2040-2ed0-49c0-83b8-46ad66876358', '73043041-5fe5-4cf4-a97f-bc4a12bcd296', '91f42b8f-cf6f-4eb7-851d-c5fc76f43c81', 'fa45cfad-7764-4a5d-aa9d-62e3156a6e37'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:06 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:06 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-15e3dcd4-cb37-4be8-b033-bddefef3bdca-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-15e3dcd4-cb37-4be8-b033-bddefef3bdca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-92185d44-7d25-4127-ae97-66c3f9dd844a" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-92185d44-7d25-4127-ae97-66c3f9dd844a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-15e3dcd4-cb37-4be8-b033-bddefef3bdca" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-15e3dcd4-cb37-4be8-b033-bddefef3bdca" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Deleting offline snapshot 15e3dcd4-cb37-4be8-b033-bddefef3bdca of volume 92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] snapshot_file for this snap is: volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee7682-e622-4534-b4f5-a796ce001635]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:07 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.422s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:07 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Deleted volume successfully. Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b6f47b15-75ef-434c-911e-d7581bc022fa tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-a42bb30f-9e77-44cd-9573-156e2a394b50-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:07 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca Jul 24 15:49:07 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:07 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca" returned: 0 in 0.565s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92185d44-7d25-4127-ae97-66c3f9dd844a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[178516b1-a29c-43ce-8f3a-96efbfc1e725]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:08 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a Jul 24 15:49:08 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4b17108b-087b-409d-9805-b3c89423dff3 tempest-BackendsCapabilitiesAdminTestsJSON-421225989 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88251) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 15:49:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-774742b3-4a4e-433f-b9e9-ed2c7e59770d tempest-BackendsCapabilitiesAdminTestsJSON-421225989 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88251) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 15:49:08 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a" returned: 0 in 0.509s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:08 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca Jul 24 15:49:08 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:08 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca" returned: 0 in 0.477s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:08 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca Jul 24 15:49:08 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:09 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a.15e3dcd4-cb37-4be8-b033-bddefef3bdca" returned: 0 in 0.302s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-15e3dcd4-cb37-4be8-b033-bddefef3bdca" released by "_delete_snapshot" :: held 2.015s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-92185d44-7d25-4127-ae97-66c3f9dd844a" released by "delete_snapshot" :: held 2.062s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:09 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Created reservations ['8cf020a6-ee01-4a8f-aaf6-ab1dc6d52c6e', 'c38e797e-5c9f-477a-93bf-66abaecc8f5c', '0ee8bc19-4890-4ba5-9dea-a9b96ed9b19d', '0ac895aa-c445-4766-80a9-bf7392ea7a4e'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Delete snapshot completed successfully. Jul 24 15:49:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79faccd0-3fea-4bb8-9ee2-be2a338b8ea4 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-15e3dcd4-cb37-4be8-b033-bddefef3bdca-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-92185d44-7d25-4127-ae97-66c3f9dd844a-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-92185d44-7d25-4127-ae97-66c3f9dd844a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-92185d44-7d25-4127-ae97-66c3f9dd844a" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-92185d44-7d25-4127-ae97-66c3f9dd844a" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b2c26c-33f8-4200-83be-e9bf1ef3335b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:10 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a Jul 24 15:49:10 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:11 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a" returned: 0 in 0.550s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:11 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a Jul 24 15:49:11 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:11 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-92185d44-7d25-4127-ae97-66c3f9dd844a" returned: 0 in 0.328s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-92185d44-7d25-4127-ae97-66c3f9dd844a" released by "delete_volume" :: held 0.975s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:11 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Created reservations ['6f115245-c6ea-450d-a995-b7bfbb8b3ce4', 'cbb88437-d30c-46e1-b27d-d89991d55baa', '38c1f11b-dbe4-42cd-8cb6-8e9322157f21', '8e53ecf6-6e52-4765-accf-6f388607b5cd'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:12 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:12 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:12 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.302s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:12 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Deleted volume successfully. Jul 24 15:49:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8fbc8f4e-27a5-4b5b-9176-533248ec12b3 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-92185d44-7d25-4127-ae97-66c3f9dd844a-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (c9f486e5-b9de-44e9-a7a9-c3812234cd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cf1694-6062-4f53-a238-09ec6ff9473e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cf1694-6062-4f53-a238-09ec6ff9473e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-375793479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e78c556-c874-4047-8107-066de3ad8f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3b63a77144442e9f809189a0ff8779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:14Z,use_quota=True,user_id='d8feb74c3cd84b7baf5ca226731d12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84051c73-dec1-4a12-b9cc-920938cba49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84051c73-dec1-4a12-b9cc-920938cba49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d7c175-9ecd-4e02-9574-92649bb5fc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d7c175-9ecd-4e02-9574-92649bb5fc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e78c556-c874-4047-8107-066de3ad8f04', 'volume_name': 'volume-0e78c556-c874-4047-8107-066de3ad8f04', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11404a2-ceba-42b4-a3fb-99654b20a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11404a2-ceba-42b4-a3fb-99654b20a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163fd211-2372-424a-8d80-285bf2ac7f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:13 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume 0e78c556-c874-4047-8107-066de3ad8f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e78c556-c874-4047-8107-066de3ad8f04', 'volume_size': 1} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-375793479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e78c556-c874-4047-8107-066de3ad8f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3b63a77144442e9f809189a0ff8779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:14Z,use_quota=True,user_id='d8feb74c3cd84b7baf5ca226731d12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Creating volume 0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:13 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:14 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 1073741824 Jul 24 15:49:14 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d9a062be-0418-4377-b658-6b5cfd74dabf tempest-GroupsTest-1898594711 None] Group tempest-Group1-1839216531: creating Jul 24 15:49:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d9a062be-0418-4377-b658-6b5cfd74dabf tempest-GroupsTest-1898594711 None] Group tempest-Group1-1839216531: created successfully Jul 24 15:49:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d9a062be-0418-4377-b658-6b5cfd74dabf tempest-GroupsTest-1898594711 None] Create group completed successfully. Jul 24 15:49:14 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 1073741824" returned: 0 in 0.602s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:14 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 Jul 24 15:49:14 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:14 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163fd211-2372-424a-8d80-285bf2ac7f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e78c556-c874-4047-8107-066de3ad8f04', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b9f358-b112-4025-b819-3e9a4253adc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume volume-0e78c556-c874-4047-8107-066de3ad8f04 (0e78c556-c874-4047-8107-066de3ad8f04): created successfully Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b9f358-b112-4025-b819-3e9a4253adc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (c9f486e5-b9de-44e9-a7a9-c3812234cd68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1067cf5e-2ceb-41a7-80fb-8bd73b91c700 tempest-VolumesSnapshotTestJSON-1693284829 None] Created volume successfully. Jul 24 15:49:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-69cf4285-14f3-40e2-a0c5-d4a13e18d29b tempest-GroupsTest-1898594711 None] Group tempest-Group2-11356709: creating Jul 24 15:49:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-69cf4285-14f3-40e2-a0c5-d4a13e18d29b tempest-GroupsTest-1898594711 None] Group tempest-Group2-11356709: created successfully Jul 24 15:49:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-69cf4285-14f3-40e2-a0c5-d4a13e18d29b tempest-GroupsTest-1898594711 None] Create group completed successfully. Jul 24 15:49:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Creating offline snapshot df692525-ffdd-4db8-b16e-6cc3fea9f849 of volume 0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:49:16 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e587c6-85f7-4f62-ac55-339e9a16e867]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:16 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 Jul 24 15:49:16 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:16 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04" returned: 0 in 0.532s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:16 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 1G Jul 24 15:49:16 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:17 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 1G" returned: 0 in 0.653s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e78c556-c874-4047-8107-066de3ad8f04 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:17 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e78c556-c874-4047-8107-066de3ad8f04 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 Jul 24 15:49:17 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Flow 'volume_create_manager' (877dee49-b8c9-4a8c-987b-6d917ba02555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bf2455-c3ad-4706-9050-4fffd1b0228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bf2455-c3ad-4706-9050-4fffd1b0228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1750751166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c52ce565-7beb-4a2a-a6ba-a5e9994e759d,host='devstack@QuobyteHD#QuobyteHD',id=b7eb814d-3396-427f-adb8-2a4a9a3a6c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17733ce936448d1aa60da5bd700ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:18Z,use_quota=True,user_id='d346b65545434ed2b6bea60863fae987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d83d4d6a-1112-4bb2-adb9-92002b61c0d9),volume_type_id=d83d4d6a-1112-4bb2-adb9-92002b61c0d9)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc83eb77-a302-4cf9-96ed-0fd6ff5f8058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc83eb77-a302-4cf9-96ed-0fd6ff5f8058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a00d193-72e7-4e37-b3c9-c3c1d7674ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a00d193-72e7-4e37-b3c9-c3c1d7674ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7eb814d-3396-427f-adb8-2a4a9a3a6c6c', 'volume_name': 'volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee522079-e64e-4492-86f1-45e0948368f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee522079-e64e-4492-86f1-45e0948368f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fdcb24-4023-4e99-97e4-017dfe714725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:17 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Volume b7eb814d-3396-427f-adb8-2a4a9a3a6c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c', 'volume_size': 1} Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:17 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e78c556-c874-4047-8107-066de3ad8f04 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849" returned: 0 in 0.500s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:17 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 is being set with open permissions: ugo+rw Jul 24 15:49:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:17 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 Jul 24 15:49:17 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:18 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849" returned: 0 in 0.305s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:18 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.info Jul 24 15:49:18 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:18 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.info" returned: 0 in 0.293s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:18 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.info is being set with open permissions: ugo+rw Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:18 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.info Jul 24 15:49:18 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:18 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.info" returned: 0 in 0.285s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c52ce565-7beb-4a2a-a6ba-a5e9994e759d,created_at=2026-07-24T13:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1750751166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c52ce565-7beb-4a2a-a6ba-a5e9994e759d,host='devstack@QuobyteHD#QuobyteHD',id=b7eb814d-3396-427f-adb8-2a4a9a3a6c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17733ce936448d1aa60da5bd700ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:18Z,use_quota=True,user_id='d346b65545434ed2b6bea60863fae987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d83d4d6a-1112-4bb2-adb9-92002b61c0d9),volume_type_id=d83d4d6a-1112-4bb2-adb9-92002b61c0d9)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Creating volume b7eb814d-3396-427f-adb8-2a4a9a3a6c6c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:18 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:18 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c 1073741824 Jul 24 15:49:18 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3c0bb03f-57d8-49e7-839f-4c489a929b6e tempest-VolumesSnapshotTestJSON-1693284829 None] Create snapshot completed successfully Jul 24 15:49:19 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c 1073741824" returned: 0 in 0.684s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:19 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c Jul 24 15:49:19 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:19 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c" returned: 0 in 0.304s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fdcb24-4023-4e99-97e4-017dfe714725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f402060c-d8ef-42c0-829d-953a4b36bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:19 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Volume volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c (b7eb814d-3396-427f-adb8-2a4a9a3a6c6c): created successfully Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f402060c-d8ef-42c0-829d-953a4b36bb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Flow 'volume_create_manager' (877dee49-b8c9-4a8c-987b-6d917ba02555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:19 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9ce56bc7-a3e3-4640-9f60-5a527a177e21 tempest-GroupsTest-1898594711 None] Created volume successfully. Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (e9986866-6364-4716-a3db-fd69d22574a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68aaa1c8-1faf-4406-be7d-368f501a4566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68aaa1c8-1faf-4406-be7d-368f501a4566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1787012927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7041c97-1d69-43ce-8155-f2a99d99edac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3b63a77144442e9f809189a0ff8779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df692525-ffdd-4db8-b16e-6cc3fea9f849,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:20Z,use_quota=True,user_id='d8feb74c3cd84b7baf5ca226731d12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b3daea-176c-4f88-b375-197168589c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b3daea-176c-4f88-b375-197168589c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4682b9-2a98-47a6-8532-78ef3b0b0ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4682b9-2a98-47a6-8532-78ef3b0b0ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7041c97-1d69-43ce-8155-f2a99d99edac', 'volume_name': 'volume-c7041c97-1d69-43ce-8155-f2a99d99edac', 'volume_size': 1, 'snapshot_id': 'df692525-ffdd-4db8-b16e-6cc3fea9f849'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713af803-315d-4213-85ad-7c2902f8b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713af803-315d-4213-85ad-7c2902f8b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5cac6f4-ba4a-4186-bf72-8e559a6571a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:20 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume c7041c97-1d69-43ce-8155-f2a99d99edac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7041c97-1d69-43ce-8155-f2a99d99edac', 'volume_size': 1, 'snapshot_id': 'df692525-ffdd-4db8-b16e-6cc3fea9f849'} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-df692525-ffdd-4db8-b16e-6cc3fea9f849-c7041c97-1d69-43ce-8155-f2a99d99edac" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-df692525-ffdd-4db8-b16e-6cc3fea9f849-c7041c97-1d69-43ce-8155-f2a99d99edac" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Creating volume c7041c97-1d69-43ce-8155-f2a99d99edac from snapshot df692525-ffdd-4db8-b16e-6cc3fea9f849 {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-c7041c97-1d69-43ce-8155-f2a99d99edac" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-c7041c97-1d69-43ce-8155-f2a99d99edac" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] snapshot: df692525-ffdd-4db8-b16e-6cc3fea9f849, volume: c7041c97-1d69-43ce-8155-f2a99d99edac, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a0fbb3-0b3b-4834-a09d-a06ee5ad0048]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:20 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 Jul 24 15:49:20 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:20 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849" returned: 0 in 0.461s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e78c556-c874-4047-8107-066de3ad8f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c07c4bc-dacc-4f95-a109-a0c7e53cdd99]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Acquiring lock "cinder-quobyte-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Lock "cinder-quobyte-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:20 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 Jul 24 15:49:20 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a15ad52-536e-4c00-96bc-cb962270b82e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:21 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c Jul 24 15:49:21 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:21 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04" returned: 0 in 0.495s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:21 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac Jul 24 15:49:21 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:21 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c" returned: 0 in 0.464s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:21 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c Jul 24 15:49:21 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:21 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c" returned: 0 in 0.365s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Lock "cinder-quobyte-b7eb814d-3396-427f-adb8-2a4a9a3a6c6c" released by "delete_volume" :: held 0.912s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:22 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Created reservations ['4ac91e1f-264c-4d25-b731-3715f578297d'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:22 devstack cinder-volume[88251]: WARNING cinder.quota [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-780043847 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-780043847, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:22 devstack cinder-volume[88251]: WARNING cinder.quota [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-780043847 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-780043847, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:22 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Created reservations ['63d64203-4a97-4615-b29b-4e86ec30bbfa', '3826ab01-4840-4633-8947-09a628481710', '81c1d48f-15f7-4a11-851e-6dd8e0a47228', 'ed1f8991-9441-4466-b747-1848a7209c73'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:22 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:22 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:23 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.737s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-80182cb2-0ab6-498e-8203-c87f6f7488b1 tempest-GroupsTest-1898594711 None] Delete group completed successfully. Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Created reservations ['0d342307-0095-4baf-90d3-1464a7e193c4'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-22f103a3-9893-4ccc-a605-080acccd9d2b tempest-GroupsV314Test-1586753510 None] Group tempest-GroupsV314Test-Group-498869712: creating Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (086eb324-fc84-49e6-9547-37f3e4d5667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc129f9c-9eb3-436d-ad59-7c268cff34ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc129f9c-9eb3-436d-ad59-7c268cff34ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831088702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2970bee1-caf4-49f8-81d8-123d78c6ffaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:24Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5f83f6-3c6a-4e57-a34d-777c28d28571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5f83f6-3c6a-4e57-a34d-777c28d28571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e91d8a-0a78-42c8-ac92-80a7e363bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e91d8a-0a78-42c8-ac92-80a7e363bc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2970bee1-caf4-49f8-81d8-123d78c6ffaf', 'volume_name': 'volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6726ea6b-af5f-4d34-aae1-d6e46ae33d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6726ea6b-af5f-4d34-aae1-d6e46ae33d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521cc123-c1cf-4bea-a055-20c493541554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:23 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume 2970bee1-caf4-49f8-81d8-123d78c6ffaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf', 'volume_size': 1} Jul 24 15:49:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-22f103a3-9893-4ccc-a605-080acccd9d2b tempest-GroupsV314Test-1586753510 None] Group tempest-GroupsV314Test-Group-498869712: created successfully Jul 24 15:49:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-22f103a3-9893-4ccc-a605-080acccd9d2b tempest-GroupsV314Test-1586753510 None] Create group completed successfully. Jul 24 15:49:24 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:24 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:24 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.663s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:24 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e0fa5bb1-3ee2-4ad7-aca8-1c92873d4f26 tempest-GroupsTest-1898594711 None] Delete group completed successfully. Jul 24 15:49:25 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Flow 'volume_create_manager' (4af88d75-9f8e-4665-bb6d-e59633282ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f069d2-bc8a-4946-9839-430ea029e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f069d2-bc8a-4946-9839-430ea029e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-246164943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84614365-d69e-44de-9618-a7a3eae904dd,host='devstack@QuobyteHD#QuobyteHD',id=b24f1270-b155-4a47-85a1-a43bb0eb81c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdae3ddf030d4a6cbecc025092d4a93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:26Z,use_quota=True,user_id='226cee488cb145f69118d290c4466499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb9e30f-7ce6-43d4-840f-5fc8ebbc2cbd),volume_type_id=9fb9e30f-7ce6-43d4-840f-5fc8ebbc2cbd)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9507d0be-f9a5-4bcd-b71c-6300824b3be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9507d0be-f9a5-4bcd-b71c-6300824b3be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307694a8-533a-4f7b-a243-becbea822738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307694a8-533a-4f7b-a243-becbea822738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24f1270-b155-4a47-85a1-a43bb0eb81c8', 'volume_name': 'volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6afb1bf-25bb-4e95-a355-a1c28ecd5f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6afb1bf-25bb-4e95-a355-a1c28ecd5f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbc4299-7d1f-407d-b0c1-5bf4290c58f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Volume b24f1270-b155-4a47-85a1-a43bb0eb81c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8', 'volume_size': 1} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b160cc38-ad38-431c-8a48-338da0dd8887 tempest-GroupsTest-1898594711 None] Group tempest-GroupsTest-Group-1026601021: creating Jul 24 15:49:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b160cc38-ad38-431c-8a48-338da0dd8887 tempest-GroupsTest-1898594711 None] Group tempest-GroupsTest-Group-1026601021: created successfully Jul 24 15:49:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b160cc38-ad38-431c-8a48-338da0dd8887 tempest-GroupsTest-1898594711 None] Create group completed successfully. Jul 24 15:49:26 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac" returned: 0 in 5.646s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7c8ee5-ea8a-4c67-88f2-f1299ff1927a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:27 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 Jul 24 15:49:27 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:27 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04" returned: 0 in 0.561s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:49:27 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Converted 1024.00 MB image at 181.32 MB/s Jul 24 15:49:27 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac is being set with open permissions: ugo+rw Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:27 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac Jul 24 15:49:27 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:27 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac" returned: 0 in 0.274s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-c7041c97-1d69-43ce-8155-f2a99d99edac" released by "_copy_volume_from_snapshot" :: held 7.559s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-df692525-ffdd-4db8-b16e-6cc3fea9f849-c7041c97-1d69-43ce-8155-f2a99d99edac" released by "_create_volume_from_snapshot" :: held 7.597s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.616s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.862s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831088702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2970bee1-caf4-49f8-81d8-123d78c6ffaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:24Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Creating volume 2970bee1-caf4-49f8-81d8-123d78c6ffaf {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:27 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:27 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf 1073741824 Jul 24 15:49:27 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5cac6f4-ba4a-4186-bf72-8e559a6571a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7041c97-1d69-43ce-8155-f2a99d99edac', 'volume_size': 1, 'snapshot_id': 'df692525-ffdd-4db8-b16e-6cc3fea9f849'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437a8525-ad83-4a94-a6db-0b19fbc52f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:27 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Volume volume-c7041c97-1d69-43ce-8155-f2a99d99edac (c7041c97-1d69-43ce-8155-f2a99d99edac): created successfully Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437a8525-ad83-4a94-a6db-0b19fbc52f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Flow 'volume_create_manager' (e9986866-6364-4716-a3db-fd69d22574a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:27 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Flow 'volume_create_manager' (e72e2944-cfc7-4f07-92ec-3fc98fbcb9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521cb6a6-9004-47cb-8b5b-d3f8c59838d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e68861b0-5aec-4e87-a817-385e9c256b02 tempest-VolumesSnapshotTestJSON-1693284829 None] Created volume successfully. Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521cb6a6-9004-47cb-8b5b-d3f8c59838d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-343968672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=916c5fe5-9aa6-487a-8812-474eb077d745,host='devstack@QuobyteHD#QuobyteHD',id=930cb73b-a1ea-41ac-8c3d-ac810f5e5b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17733ce936448d1aa60da5bd700ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:28Z,use_quota=True,user_id='d346b65545434ed2b6bea60863fae987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0179b521-21e6-48fd-a667-a73bb8471f5d),volume_type_id=0179b521-21e6-48fd-a667-a73bb8471f5d)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d175d6b-c615-42d2-9e2b-af99404b4080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d175d6b-c615-42d2-9e2b-af99404b4080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5ed627-f9b5-40ac-a691-af3ec6faf5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5ed627-f9b5-40ac-a691-af3ec6faf5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930cb73b-a1ea-41ac-8c3d-ac810f5e5b07', 'volume_name': 'volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d6c29f-e973-4a3d-bc5d-be1906275b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d6c29f-e973-4a3d-bc5d-be1906275b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaade6af-9612-47b0-ac1b-4d461791835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:28 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Volume 930cb73b-a1ea-41ac-8c3d-ac810f5e5b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07', 'volume_size': 1} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:28 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf 1073741824" returned: 0 in 0.456s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:28 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf Jul 24 15:49:28 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:28 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf" returned: 0 in 0.253s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.359s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84614365-d69e-44de-9618-a7a3eae904dd,created_at=2026-07-24T13:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-246164943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84614365-d69e-44de-9618-a7a3eae904dd,host='devstack@QuobyteHD#QuobyteHD',id=b24f1270-b155-4a47-85a1-a43bb0eb81c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdae3ddf030d4a6cbecc025092d4a93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:26Z,use_quota=True,user_id='226cee488cb145f69118d290c4466499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb9e30f-7ce6-43d4-840f-5fc8ebbc2cbd),volume_type_id=9fb9e30f-7ce6-43d4-840f-5fc8ebbc2cbd)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Creating volume b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:28 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:28 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 1073741824 Jul 24 15:49:28 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521cc123-c1cf-4bea-a055-20c493541554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15de2f87-adbd-44dc-89b4-504c03fb66bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:28 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf (2970bee1-caf4-49f8-81d8-123d78c6ffaf): created successfully Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15de2f87-adbd-44dc-89b4-504c03fb66bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (086eb324-fc84-49e6-9547-37f3e4d5667c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-141c24c2-489b-49b5-afef-53681c312585 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created volume successfully. Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-c7041c97-1d69-43ce-8155-f2a99d99edac-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-c7041c97-1d69-43ce-8155-f2a99d99edac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-c7041c97-1d69-43ce-8155-f2a99d99edac" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-c7041c97-1d69-43ce-8155-f2a99d99edac" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[932389da-8dc7-42fd-b67b-3dd3fe456622]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:28 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac Jul 24 15:49:28 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:29 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 1073741824" returned: 0 in 0.519s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:29 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 Jul 24 15:49:29 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:29 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac" returned: 0 in 0.456s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:29 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac Jul 24 15:49:29 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:29 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8" returned: 0 in 0.288s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.383s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=916c5fe5-9aa6-487a-8812-474eb077d745,created_at=2026-07-24T13:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-343968672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=916c5fe5-9aa6-487a-8812-474eb077d745,host='devstack@QuobyteHD#QuobyteHD',id=930cb73b-a1ea-41ac-8c3d-ac810f5e5b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17733ce936448d1aa60da5bd700ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:28Z,use_quota=True,user_id='d346b65545434ed2b6bea60863fae987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0179b521-21e6-48fd-a667-a73bb8471f5d),volume_type_id=0179b521-21e6-48fd-a667-a73bb8471f5d)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Creating volume 930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:29 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:29 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 1073741824 Jul 24 15:49:29 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbc4299-7d1f-407d-b0c1-5bf4290c58f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99200f3-0958-45d9-b69e-af5e83e9e219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:29 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Volume volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 (b24f1270-b155-4a47-85a1-a43bb0eb81c8): created successfully Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99200f3-0958-45d9-b69e-af5e83e9e219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Flow 'volume_create_manager' (4af88d75-9f8e-4665-bb6d-e59633282ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-583f947f-cceb-447d-8c2b-de18a96f53ba tempest-GroupsV314Test-1586753510 None] Created volume successfully. Jul 24 15:49:29 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c7041c97-1d69-43ce-8155-f2a99d99edac" returned: 0 in 0.320s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-c7041c97-1d69-43ce-8155-f2a99d99edac" released by "delete_volume" :: held 0.820s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Created reservations ['cd9e3176-6454-4dfb-930e-61a82dd828f1', '796f38c5-6d8b-4cc5-8985-90d307533722', '6f9fa0f8-abc2-41b2-bec8-daf77e81dbaa', '94877388-f318-423b-ac9f-3bd837d38456'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:29 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:29 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-df692525-ffdd-4db8-b16e-6cc3fea9f849-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-df692525-ffdd-4db8-b16e-6cc3fea9f849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-0e78c556-c874-4047-8107-066de3ad8f04" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-0e78c556-c874-4047-8107-066de3ad8f04" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-df692525-ffdd-4db8-b16e-6cc3fea9f849" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-df692525-ffdd-4db8-b16e-6cc3fea9f849" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Deleting offline snapshot df692525-ffdd-4db8-b16e-6cc3fea9f849 of volume 0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] snapshot_file for this snap is: volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:49:30 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 1073741824" returned: 0 in 0.608s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2221dc-ec6e-41cc-a03a-76ab694d8f45]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:30 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.354s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Deleted volume successfully. Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26e9703d-fd95-483a-a788-3c8dff7443ae tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-c7041c97-1d69-43ce-8155-f2a99d99edac-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:30 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 Jul 24 15:49:30 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:30 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 Jul 24 15:49:30 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:30 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07" returned: 0 in 0.321s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.203s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaade6af-9612-47b0-ac1b-4d461791835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51890d1-4139-47b7-bb5b-e46a7a5e234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Creating offline snapshot f2033944-d885-4035-b8ba-c463989a7ef2 of volume 2970bee1-caf4-49f8-81d8-123d78c6ffaf {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:49:30 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Volume volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 (930cb73b-a1ea-41ac-8c3d-ac810f5e5b07): created successfully Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51890d1-4139-47b7-bb5b-e46a7a5e234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Flow 'volume_create_manager' (e72e2944-cfc7-4f07-92ec-3fc98fbcb9e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdc450d-bcf9-4cfa-a838-85801bc6686d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d016daaf-893f-4ed3-bcf3-a3e1d55d395c tempest-GroupsTest-1898594711 None] Created volume successfully. Jul 24 15:49:30 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849" returned: 0 in 0.476s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e78c556-c874-4047-8107-066de3ad8f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1a233e-5d92-4915-884d-0e86cedec074]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:30 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf Jul 24 15:49:30 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:30 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 Jul 24 15:49:30 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:30 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf" returned: 0 in 0.406s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:30 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:30 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 1G Jul 24 15:49:30 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04" returned: 0 in 0.360s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:30 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 Jul 24 15:49:30 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:31 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849" returned: 0 in 0.355s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:31 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 1G" returned: 0 in 0.402s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:31 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849 Jul 24 15:49:31 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:31 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 Jul 24 15:49:31 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:31 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04.df692525-ffdd-4db8-b16e-6cc3fea9f849" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-df692525-ffdd-4db8-b16e-6cc3fea9f849" released by "_delete_snapshot" :: held 1.616s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-0e78c556-c874-4047-8107-066de3ad8f04" released by "delete_snapshot" :: held 1.644s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:31 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2" returned: 0 in 0.327s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:31 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 is being set with open permissions: ugo+rw Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:31 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 Jul 24 15:49:31 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Created reservations ['293c582d-c863-49d9-88c1-86e5defed513', '15294614-21c5-44d2-ad1a-6d1b0223f31f', '94a1bf9c-d7c0-4948-9d11-f5738377fc41', 'a81ef723-d5c6-44c4-a2ef-486ba8f6df70'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Delete snapshot completed successfully. Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ac83857b-f8d6-4983-a406-a74b5f071c67 tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-df692525-ffdd-4db8-b16e-6cc3fea9f849-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:31 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2" returned: 0 in 0.272s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:32 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.info Jul 24 15:49:32 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Flow 'volume_create_manager' (f0823abd-7258-463c-8c01-1dee383f8efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a30c7a-8a65-4d5c-9b15-7f8edff6eab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a30c7a-8a65-4d5c-9b15-7f8edff6eab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-71727626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=916c5fe5-9aa6-487a-8812-474eb077d745,host='devstack@QuobyteHD#QuobyteHD',id=9c9d700b-be7e-42fb-8d90-2c896da7aa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17733ce936448d1aa60da5bd700ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:32Z,use_quota=True,user_id='d346b65545434ed2b6bea60863fae987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0179b521-21e6-48fd-a667-a73bb8471f5d),volume_type_id=0179b521-21e6-48fd-a667-a73bb8471f5d)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bae395b-61d6-4e68-a1cb-09747f7f3c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bae395b-61d6-4e68-a1cb-09747f7f3c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1df9bc-f5bb-4b7f-9c67-fa66234bee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1df9bc-f5bb-4b7f-9c67-fa66234bee5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9d700b-be7e-42fb-8d90-2c896da7aa12', 'volume_name': 'volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3888512e-fb67-42d6-9e84-0819ac8bad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3888512e-fb67-42d6-9e84-0819ac8bad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4887026-ae85-469c-9c4c-0edbf4b4f2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:32 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Volume 9c9d700b-be7e-42fb-8d90-2c896da7aa12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12', 'volume_size': 1} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-0e78c556-c874-4047-8107-066de3ad8f04-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-0e78c556-c874-4047-8107-066de3ad8f04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:32 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.info" returned: 0 in 0.333s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:32 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.info is being set with open permissions: ugo+rw Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:32 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.info Jul 24 15:49:32 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-0e78c556-c874-4047-8107-066de3ad8f04" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-0e78c556-c874-4047-8107-066de3ad8f04" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfc4ff-dc66-4162-b63e-a07ecb74e6dc]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:32 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 Jul 24 15:49:32 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:32 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.info" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.162s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:32 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Cloning volume b24f1270-b155-4a47-85a1-a43bb0eb81c8 to volume 0498d229-fd15-44f5-b422-04fa3e647b92 Jul 24 15:49:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-24aaa01f-89b2-4b2a-be76-fd5262f642a1 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Create snapshot completed successfully Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Creating offline snapshot 0a14966e-9805-47b1-a83e-54e10b66ba3d of volume b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6748f9c-ea3e-4090-9cd5-f0bd9951228d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:32 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 Jul 24 15:49:32 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:32 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04" returned: 0 in 0.354s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:32 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04 Jul 24 15:49:32 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:33 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0e78c556-c874-4047-8107-066de3ad8f04" returned: 0 in 0.247s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:33 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8" returned: 0 in 0.382s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-0e78c556-c874-4047-8107-066de3ad8f04" released by "delete_volume" :: held 0.690s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:33 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d 1G Jul 24 15:49:33 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Created reservations ['cece49fc-4c64-435f-8386-1f0027736f4e', 'cff6ad08-7811-471c-8fab-e35f15c469a9', '4d569eb8-1c82-4421-9fc5-a2ab7dc7b0de', '7f131994-4c4c-4b1f-886c-790b3f11ad49'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:33 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:33 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:33 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.286s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:33 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Deleted volume successfully. Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fa939e29-e7f6-44bc-b46c-77ac4b031bad tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-0e78c556-c874-4047-8107-066de3ad8f04-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-1d749902-36e9-4191-b5f7-fa9b24c91152-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-1d749902-36e9-4191-b5f7-fa9b24c91152-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:33 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d 1G" returned: 0 in 0.542s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "cinder-quobyte-1d749902-36e9-4191-b5f7-fa9b24c91152" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:33 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d Jul 24 15:49:33 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-1d749902-36e9-4191-b5f7-fa9b24c91152" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f42e4de-b7da-4088-965d-204fb6be708a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:33 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 Jul 24 15:49:33 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:33 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:33 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:49:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:33 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d Jul 24 15:49:33 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (7c4d0662-7f83-427c-aee1-911b7527b759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f5a9de-3d3f-4b6b-8b6c-254fa14c7c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f5a9de-3d3f-4b6b-8b6c-254fa14c7c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388377677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:34Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:34 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78744ed0-2a91-45b2-a517-28430877f29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78744ed0-2a91-45b2-a517-28430877f29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfa46f5-27b6-4528-99b9-b7fe98b800a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfa46f5-27b6-4528-99b9-b7fe98b800a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee', 'volume_name': 'volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a02897-d5fb-45f2-8d6e-823a74d3a4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a02897-d5fb-45f2-8d6e-823a74d3a4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff7371c-a4a4-4d7e-b14a-5d6a10ef7122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume 4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee', 'volume_size': 1} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152" returned: 0 in 0.496s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152 Jul 24 15:49:34 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d" returned: 0 in 0.346s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.info Jul 24 15:49:34 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (0c8f1fab-fbb0-477d-b3a3-1ac5e2febd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9d0d4a-1291-4de4-bb8e-5a30c1c58db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d749902-36e9-4191-b5f7-fa9b24c91152" returned: 0 in 0.381s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9d0d4a-1291-4de4-bb8e-5a30c1c58db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183762580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9ae20b-bffd-4c38-866d-abbf9b65755c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:34Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939877af-7455-4b0b-a18a-9bb4d9cc38dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939877af-7455-4b0b-a18a-9bb4d9cc38dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db41977-e4dc-454b-86c8-323865193ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db41977-e4dc-454b-86c8-323865193ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9ae20b-bffd-4c38-866d-abbf9b65755c', 'volume_name': 'volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4be4bf-de2e-4f8f-b0e2-a5d784c705f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4be4bf-de2e-4f8f-b0e2-a5d784c705f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ec3ca8-dc74-4c67-b8ef-35fe2f8bb075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:34 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume 2b9ae20b-bffd-4c38-866d-abbf9b65755c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c', 'volume_size': 1} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-quobyte-1d749902-36e9-4191-b5f7-fa9b24c91152" released by "delete_volume" :: held 1.003s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Created reservations ['7f446e8e-05bf-48bb-adbc-489cfe31f522', '50901232-5cbf-449d-930e-91cba1c9cc74', '4fbdee98-b61b-4909-bf40-c486caf71123', 'a8a91ce9-7847-45cb-b0f3-477e0b9991af'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:34 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.info" returned: 0 in 0.376s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:34 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.info Jul 24 15:49:34 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:34 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:34 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:35 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (f72b3306-8652-4c20-a5bb-4d2e9691fd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abcdb66-5197-405f-bb10-564ed8972807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.info" returned: 0 in 0.360s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Acquiring lock "cinder-quobyte-0498d229-fd15-44f5-b422-04fa3e647b92" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:35 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abcdb66-5197-405f-bb10-564ed8972807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1662355151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a7e8c5-aed0-4080-a599-6166edba7a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:35Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529406aa-d1f9-430e-a49c-6b0da216646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529406aa-d1f9-430e-a49c-6b0da216646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8663c1f-840b-4a39-88d4-043d85886629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8663c1f-840b-4a39-88d4-043d85886629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a7e8c5-aed0-4080-a599-6166edba7a0f', 'volume_name': 'volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173c3399-25e0-44bb-b082-b659aeaf3a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173c3399-25e0-44bb-b082-b659aeaf3a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e67c461-df4d-49f9-b5f9-658bf5dc1165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume d0a7e8c5-aed0-4080-a599-6166edba7a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f', 'volume_size': 1} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Lock "cinder-quobyte-0498d229-fd15-44f5-b422-04fa3e647b92" acquired by "_copy_volume_from_snapshot" :: waited 0.092s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] snapshot: 0a14966e-9805-47b1-a83e-54e10b66ba3d, volume: 0498d229-fd15-44f5-b422-04fa3e647b92, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.465s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:35 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.366s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 28 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47ad49e-da12-457e-ab0d-f5c6ebd9132e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Deleted volume successfully. Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-692f61ae-9b11-4d0f-81ae-a2dd6a33e56b tempest-VolumesSnapshotTestJSON-1693284829 None] Lock "cinder-1d749902-36e9-4191-b5f7-fa9b24c91152-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:35 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d Jul 24 15:49:35 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (bd2a7789-c2db-444c-8789-6fc8825452ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31f5333-4892-4ee8-b38c-365413bc8214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31f5333-4892-4ee8-b38c-365413bc8214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2078272812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2f70b5-5fb6-484b-8280-4db736590592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:35Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31654b17-97b5-49f3-885a-76a35bf919b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31654b17-97b5-49f3-885a-76a35bf919b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139c3f7b-de75-46b9-b49a-411d5726a7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139c3f7b-de75-46b9-b49a-411d5726a7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2f70b5-5fb6-484b-8280-4db736590592', 'volume_name': 'volume-fb2f70b5-5fb6-484b-8280-4db736590592', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45d4c9e-a9ab-4f6c-a4a7-080e2e6d137a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45d4c9e-a9ab-4f6c-a4a7-080e2e6d137a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8cb756-b2ce-4522-9753-a1cebd3c1cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume fb2f70b5-5fb6-484b-8280-4db736590592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2f70b5-5fb6-484b-8280-4db736590592', 'volume_size': 1} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:35 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d" returned: 0 in 0.507s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e301a6d-60d1-4c3d-a393-a4335f8a23b6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=207,cinder:INSERT=44,cinder:UPDATE=199,cinder:DELETE=14 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=197,cinder:INSERT=57,cinder:UPDATE=224,cinder:DELETE=13 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:35 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 Jul 24 15:49:35 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (7a5b8797-5bea-400b-81c2-87abc6c09977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbce4b68-51c8-415c-b671-b1865b185359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbce4b68-51c8-415c-b671-b1865b185359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919046064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bb7b9f-8d90-4b36-a1b0-54adf37626e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:36Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f970e9-7e8c-4034-9549-965667ccc48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f970e9-7e8c-4034-9549-965667ccc48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201654eb-9f20-4536-886d-2d89c336b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201654eb-9f20-4536-886d-2d89c336b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bb7b9f-8d90-4b36-a1b0-54adf37626e6', 'volume_name': 'volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cb0e13-8b1d-46c7-82d9-59293d1f4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cb0e13-8b1d-46c7-82d9-59293d1f4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac1a271-f7a1-445a-807f-b39372c895be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:35 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume 63bb7b9f-8d90-4b36-a1b0-54adf37626e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6', 'volume_size': 1} Jul 24 15:49:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:36 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8" returned: 0 in 0.374s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:36 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:49:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:36 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 Jul 24 15:49:36 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:41 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92" returned: 0 in 4.931s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cccaa1a-11c8-4d65-86a6-f40eb46c610e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:41 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 Jul 24 15:49:41 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:41 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8" returned: 0 in 0.607s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:41 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:49:41 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Converted 1024.00 MB image at 207.63 MB/s Jul 24 15:49:41 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:49:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:41 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 Jul 24 15:49:41 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:41 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92" returned: 0 in 0.261s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Lock "cinder-quobyte-0498d229-fd15-44f5-b422-04fa3e647b92" released by "_copy_volume_from_snapshot" :: held 6.793s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Acquiring lock "cinder-quobyte-0a14966e-9805-47b1-a83e-54e10b66ba3d" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Lock "cinder-quobyte-0a14966e-9805-47b1-a83e-54e10b66ba3d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Deleting offline snapshot 0a14966e-9805-47b1-a83e-54e10b66ba3d of volume b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] snapshot_file for this snap is: volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[481dec8f-25e4-47f9-8dc9-e4b8b0f2aeae]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:42 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d Jul 24 15:49:42 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:42 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d" returned: 0 in 0.434s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb10a32-85e4-46c7-b3ce-09bf2356d2cd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:42 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 Jul 24 15:49:42 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:42 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8" returned: 0 in 0.360s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:42 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d Jul 24 15:49:42 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:43 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d" returned: 0 in 0.381s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:43 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d Jul 24 15:49:43 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:43 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8.0a14966e-9805-47b1-a83e-54e10b66ba3d" returned: 0 in 0.259s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Lock "cinder-quobyte-0a14966e-9805-47b1-a83e-54e10b66ba3d" released by "_delete_snapshot" :: held 1.572s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.045s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.365s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=916c5fe5-9aa6-487a-8812-474eb077d745,created_at=2026-07-24T13:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-71727626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=916c5fe5-9aa6-487a-8812-474eb077d745,host='devstack@QuobyteHD#QuobyteHD',id=9c9d700b-be7e-42fb-8d90-2c896da7aa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17733ce936448d1aa60da5bd700ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:32Z,use_quota=True,user_id='d346b65545434ed2b6bea60863fae987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0179b521-21e6-48fd-a667-a73bb8471f5d),volume_type_id=0179b521-21e6-48fd-a667-a73bb8471f5d)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Creating volume 9c9d700b-be7e-42fb-8d90-2c896da7aa12 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:43 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:43 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 1073741824 Jul 24 15:49:43 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:43 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d90e98f9-de14-4a7e-b9a3-28e1e46c4767 tempest-GroupsV314Test-1586753510 None] Create group from source-group-84614365-d69e-44de-9618-a7a3eae904dd completed successfully. Jul 24 15:49:44 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 1073741824" returned: 0 in 0.455s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:44 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 Jul 24 15:49:44 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:44 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12" returned: 0 in 0.263s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.226s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388377677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:34Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Creating volume 4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:44 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:44 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee 1073741824 Jul 24 15:49:44 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4887026-ae85-469c-9c4c-0edbf4b4f2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348a8def-5acd-4cd1-919a-d228329dce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:44 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Volume volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 (9c9d700b-be7e-42fb-8d90-2c896da7aa12): created successfully Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348a8def-5acd-4cd1-919a-d228329dce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Flow 'volume_create_manager' (f0823abd-7258-463c-8c01-1dee383f8efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:44 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ab6c70bf-1830-4447-8eae-eb88a413cc6e tempest-GroupsTest-1898594711 None] Created volume successfully. Jul 24 15:49:45 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee 1073741824" returned: 0 in 0.573s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee Jul 24 15:49:45 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d109e1cc-aec5-49c3-bdbd-69f8e241c71a tempest-GroupsTest-1898594711 None] Update group completed successfully. Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Acquiring lock "cinder-quobyte-0498d229-fd15-44f5-b422-04fa3e647b92" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Lock "cinder-quobyte-0498d229-fd15-44f5-b422-04fa3e647b92" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6303d3-5640-4cff-90fc-60ea4cf91a60]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 Jul 24 15:49:45 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:45 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee" returned: 0 in 0.409s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.815s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183762580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9ae20b-bffd-4c38-866d-abbf9b65755c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:34Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Creating volume 2b9ae20b-bffd-4c38-866d-abbf9b65755c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:45 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff7371c-a4a4-4d7e-b14a-5d6a10ef7122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:45 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c 1073741824 Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dd9afe-2a44-4348-886e-050d33137eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:45 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:45 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee (4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee): created successfully Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dd9afe-2a44-4348-886e-050d33137eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (7c4d0662-7f83-427c-aee1-911b7527b759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6ed4ee7b-1e77-4fcb-85a8-c8c25c95352a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created volume successfully. Jul 24 15:49:45 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92" returned: 0 in 0.484s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92 Jul 24 15:49:45 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:46 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0498d229-fd15-44f5-b422-04fa3e647b92" returned: 0 in 0.315s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:46 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c 1073741824" returned: 0 in 0.590s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Lock "cinder-quobyte-0498d229-fd15-44f5-b422-04fa3e647b92" released by "delete_volume" :: held 0.853s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:46 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c Jul 24 15:49:46 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Created reservations ['ec612aa1-f39b-4a26-9a3b-7ad288cc5b37'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:46 devstack cinder-volume[88251]: WARNING cinder.quota [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-965148706 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-965148706, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:46 devstack cinder-volume[88251]: WARNING cinder.quota [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-965148706 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-965148706, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Created reservations ['43d56417-97be-4257-9abf-23173e22533e', '1129dc4e-c120-4bc3-9887-305b06cf21eb', '2ac9b625-e8b2-47e7-8ddb-a54d63992afa', 'befe7abb-f9df-469e-b08f-02254d1f550a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:46 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c" returned: 0 in 0.345s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:46 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:46 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.269s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1662355151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a7e8c5-aed0-4080-a599-6166edba7a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:35Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Creating volume d0a7e8c5-aed0-4080-a599-6166edba7a0f {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:46 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ec3ca8-dc74-4c67-b8ef-35fe2f8bb075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a5d890-e5b4-4d7b-bb45-c2787a49a2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:46 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f 1073741824 Jul 24 15:49:46 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:46 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c (2b9ae20b-bffd-4c38-866d-abbf9b65755c): created successfully Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a5d890-e5b4-4d7b-bb45-c2787a49a2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (0c8f1fab-fbb0-477d-b3a3-1ac5e2febd11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0e65ce98-d9cb-4063-ac9a-a678ee7b5df0 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created volume successfully. Jul 24 15:49:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d93e7db4-e276-455b-ac44-1f79cf8b9246 tempest-GroupsTest-1898594711 None] Update group completed successfully. Jul 24 15:49:46 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.548s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1b402e5d-ee0f-4777-85d2-15522e7cce17 tempest-GroupsV314Test-1586753510 None] Delete group completed successfully. Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Acquiring lock "cinder-quobyte-b24f1270-b155-4a47-85a1-a43bb0eb81c8" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Lock "cinder-quobyte-b24f1270-b155-4a47-85a1-a43bb0eb81c8" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb29470-653e-43df-b886-7bbe4db2207b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:47 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 Jul 24 15:49:47 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:47 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f 1073741824" returned: 0 in 0.733s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:47 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f Jul 24 15:49:47 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:47 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8" returned: 0 in 0.451s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:47 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8 Jul 24 15:49:47 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:47 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f" returned: 0 in 0.278s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.976s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2078272812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2f70b5-5fb6-484b-8280-4db736590592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:35Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Creating volume fb2f70b5-5fb6-484b-8280-4db736590592 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:47 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:47 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 1073741824 Jul 24 15:49:47 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e67c461-df4d-49f9-b5f9-658bf5dc1165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9301c26-49b1-40ce-bc8a-8ecea8818659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:47 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f (d0a7e8c5-aed0-4080-a599-6166edba7a0f): created successfully Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9301c26-49b1-40ce-bc8a-8ecea8818659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (f72b3306-8652-4c20-a5bb-4d2e9691fd7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:47 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-42240031-e50d-4152-a5ef-0a240970bbb9 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created volume successfully. Jul 24 15:49:47 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b24f1270-b155-4a47-85a1-a43bb0eb81c8" returned: 0 in 0.321s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Lock "cinder-quobyte-b24f1270-b155-4a47-85a1-a43bb0eb81c8" released by "delete_volume" :: held 0.866s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Created reservations ['c2e64e21-c825-4401-a2b3-d299ef9d4ffc'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:47 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Created reservations ['93d6fed9-2b76-4779-8a43-d84e3ba9f6f7', 'e51c6cb8-cbe4-4763-a164-a48b9a15ab7e', 'd9b4a405-4437-495d-acd2-2e6253b1e6cd', '8e79c83c-d514-4d13-8ee5-3458c701c1d6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:48 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 1073741824" returned: 0 in 0.594s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:48 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:48 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:48 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 Jul 24 15:49:48 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:48 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.594s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919046064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bb7b9f-8d90-4b36-a1b0-54adf37626e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a904af5471b43c3a4d797353e30cc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:36Z,use_quota=True,user_id='20db8305106f49d3a25dec454a15838b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Creating volume 63bb7b9f-8d90-4b36-a1b0-54adf37626e6 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:48 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:48 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.504s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:48 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 1073741824 Jul 24 15:49:48 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e13a905d-3add-43cd-83a5-87112482c194 tempest-GroupsV314Test-1586753510 None] Delete group completed successfully. Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8cb756-b2ce-4522-9753-a1cebd3c1cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2f70b5-5fb6-484b-8280-4db736590592', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70b06dd-b25d-4fee-9e32-1ed1aa00abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:48 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume volume-fb2f70b5-5fb6-484b-8280-4db736590592 (fb2f70b5-5fb6-484b-8280-4db736590592): created successfully Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70b06dd-b25d-4fee-9e32-1ed1aa00abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (bd2a7789-c2db-444c-8789-6fc8825452ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1f7f9e54-334e-48ca-8a9e-9539e8aec42e tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created volume successfully. Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Acquiring lock "cinder-quobyte-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Lock "cinder-quobyte-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad08538-e7a9-4390-9d1f-e35fd7e4370b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:49 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 Jul 24 15:49:49 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:49 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 1073741824" returned: 0 in 0.672s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:49 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 Jul 24 15:49:49 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:49 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07" returned: 0 in 0.545s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:49 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07 Jul 24 15:49:49 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:49 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6" returned: 0 in 0.379s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac1a271-f7a1-445a-807f-b39372c895be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:49 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca47179-b5db-4b6f-86dd-443127803144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07" returned: 0 in 0.355s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Lock "cinder-quobyte-930cb73b-a1ea-41ac-8c3d-ac810f5e5b07" released by "delete_volume" :: held 0.973s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Acquiring lock "cinder-quobyte-9c9d700b-be7e-42fb-8d90-2c896da7aa12" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Volume volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 (63bb7b9f-8d90-4b36-a1b0-54adf37626e6): created successfully Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca47179-b5db-4b6f-86dd-443127803144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Flow 'volume_create_manager' (7a5b8797-5bea-400b-81c2-87abc6c09977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9cb2fbf8-c1e5-4465-8155-09072b1801ba tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created volume successfully. Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Lock "cinder-quobyte-9c9d700b-be7e-42fb-8d90-2c896da7aa12" acquired by "delete_volume" :: waited 0.047s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[74514e6d-a3f6-47b4-b067-8c504ba03ded]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:49 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 Jul 24 15:49:49 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:50 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12" returned: 0 in 0.471s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:50 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12 Jul 24 15:49:50 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:50 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9c9d700b-be7e-42fb-8d90-2c896da7aa12" returned: 0 in 0.385s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Lock "cinder-quobyte-9c9d700b-be7e-42fb-8d90-2c896da7aa12" released by "delete_volume" :: held 0.913s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-63bb7b9f-8d90-4b36-a1b0-54adf37626e6-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-63bb7b9f-8d90-4b36-a1b0-54adf37626e6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-quobyte-63bb7b9f-8d90-4b36-a1b0-54adf37626e6" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-63bb7b9f-8d90-4b36-a1b0-54adf37626e6" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Created reservations ['1ddd486d-f726-4499-bdea-4176d3d116a5'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e9f251-df67-4749-a868-f4ffcaf6d7a9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:50 devstack cinder-volume[88251]: WARNING cinder.quota [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1538197676 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1538197676, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:50 devstack cinder-volume[88251]: WARNING cinder.quota [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1538197676 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1538197676, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Created reservations ['70b009dd-50f9-4a94-bf2c-2b8952044c6b', '1b778b04-756a-4396-aa8f-f75eaf5481d0', '65e0f19e-2b42-4872-8d02-35e28a42238a', '6459b5bb-87be-4f06-b269-0b91145be670'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:51 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 Jul 24 15:49:51 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Created reservations ['942485b2-fe7f-4413-8973-1fa7e302b91d', '6050c1c1-2a29-47ed-bced-b001e69f0426', 'b666fa56-2b69-4e9c-b107-2763347000bd', 'b71ddf14-eb07-4a25-bca2-7b79c7911d9a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:51 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:51 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:51 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6" returned: 0 in 0.548s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:51 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6 Jul 24 15:49:51 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:51 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.321s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c4482f30-ef13-4edc-8ab7-0c65168d61db tempest-GroupsTest-1898594711 None] Delete group completed successfully. Jul 24 15:49:51 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-63bb7b9f-8d90-4b36-a1b0-54adf37626e6" returned: 0 in 0.346s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-63bb7b9f-8d90-4b36-a1b0-54adf37626e6" released by "delete_volume" :: held 0.946s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created reservations ['541cba07-b207-4387-afc6-f16bdde9ae25', 'e63ee530-a0f8-45de-9061-c8a7482fa4b8', '9c4b1eb2-dcb7-4ff3-b3d7-5b3332ff4a4e', '986e96cc-800a-4665-911a-38536966f21a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:52 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:52 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:52 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.276s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:52 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Deleted volume successfully. Jul 24 15:49:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f4dccf08-5986-4185-b915-867c57ec0bff tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-63bb7b9f-8d90-4b36-a1b0-54adf37626e6-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-fb2f70b5-5fb6-484b-8280-4db736590592-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-fb2f70b5-5fb6-484b-8280-4db736590592-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-quobyte-fb2f70b5-5fb6-484b-8280-4db736590592" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-fb2f70b5-5fb6-484b-8280-4db736590592" acquired by "delete_volume" :: waited 0.040s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:53 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c676379-aa9b-4523-a1af-0f13fcf4db96]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:53 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 Jul 24 15:49:53 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:53 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592" returned: 0 in 0.633s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:53 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592 Jul 24 15:49:53 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:54 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fb2f70b5-5fb6-484b-8280-4db736590592" returned: 0 in 0.386s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-fb2f70b5-5fb6-484b-8280-4db736590592" released by "delete_volume" :: held 1.082s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created reservations ['ef3d9cdb-255a-4f54-a754-05e971cc9541', 'c37c20ab-e2cc-4d59-a7de-223461776ee7', '830e99cf-5f54-4243-93d3-a41058fdd801', '1b7c761c-fd39-4408-a80e-1d5493cc59df'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:54 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:54 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-d0a7e8c5-aed0-4080-a599-6166edba7a0f-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-d0a7e8c5-aed0-4080-a599-6166edba7a0f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-quobyte-d0a7e8c5-aed0-4080-a599-6166edba7a0f" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-d0a7e8c5-aed0-4080-a599-6166edba7a0f" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b29d94c-644a-4ead-b785-1fdf7d34f8f6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:55 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f Jul 24 15:49:55 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:55 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.612s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:55 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Deleted volume successfully. Jul 24 15:49:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7f60067f-9289-442a-8b6c-f01a9728c978 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-fb2f70b5-5fb6-484b-8280-4db736590592-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:55 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f" returned: 0 in 0.655s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:55 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f Jul 24 15:49:55 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:55 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f050b75f-76e0-49e0-bb01-20ffd05f3a3b tempest-GroupsV320Test-829306867 None] Group tempest-GroupsV320Test-Group-1090330037: creating Jul 24 15:49:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d0a7e8c5-aed0-4080-a599-6166edba7a0f" returned: 0 in 0.417s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-d0a7e8c5-aed0-4080-a599-6166edba7a0f" released by "delete_volume" :: held 1.161s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f050b75f-76e0-49e0-bb01-20ffd05f3a3b tempest-GroupsV320Test-829306867 None] Group tempest-GroupsV320Test-Group-1090330037: created successfully Jul 24 15:49:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f050b75f-76e0-49e0-bb01-20ffd05f3a3b tempest-GroupsV320Test-829306867 None] Create group completed successfully. Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created reservations ['c9332d77-1f67-4853-a168-48f2fa0fa0fb', 'cac8d151-274c-4b35-b7ba-b41899b3daf8', '30e750fd-8e37-41c4-bbb5-837ebbec1af6', '2e86a9b0-c947-4088-999c-33b6ad5eaa2d'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:56 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:56 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:56 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.338s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Deleted volume successfully. Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0774d5ed-5956-4558-985a-4a0cceb4e753 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-d0a7e8c5-aed0-4080-a599-6166edba7a0f-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-2b9ae20b-bffd-4c38-866d-abbf9b65755c-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-2b9ae20b-bffd-4c38-866d-abbf9b65755c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-quobyte-2b9ae20b-bffd-4c38-866d-abbf9b65755c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-2b9ae20b-bffd-4c38-866d-abbf9b65755c" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce5ee3c-5339-4d82-91d5-8abfc96f24c6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:57 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c Jul 24 15:49:57 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:57 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c" returned: 0 in 0.534s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:57 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c Jul 24 15:49:57 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Created reservations ['f6da94a5-c917-4f4c-9bf0-2c5741d87a44'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:57 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:57 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:58 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2b9ae20b-bffd-4c38-866d-abbf9b65755c" returned: 0 in 0.325s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-2b9ae20b-bffd-4c38-866d-abbf9b65755c" released by "delete_volume" :: held 0.928s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created reservations ['8970fb8f-0066-4a98-9d85-893271b26ca3', 'af40c1c0-9e63-4714-9e50-939c98f4afec', '4d725985-d939-4162-bb9e-7316ce786e50', '98b71e07-da70-4880-863b-4a84ec54886e'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:58 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.330s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-cd65934f-766b-48de-8e3f-d705b7177f30 tempest-GroupsV320Test-829306867 None] Delete group completed successfully. Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:58 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:49:58 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:58 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.298s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Deleted volume successfully. Jul 24 15:49:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e8578f97-4432-4b20-adf6-2725cb52501d tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-2b9ae20b-bffd-4c38-866d-abbf9b65755c-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-quobyte-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bacd421-aa1d-4fea-8945-aebb9f6a1e83]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:59 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee Jul 24 15:49:59 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:59 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee" returned: 0 in 0.464s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:59 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee Jul 24 15:49:59 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:00 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee" returned: 0 in 0.465s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee" released by "delete_volume" :: held 0.997s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created reservations ['713f4c04-8cb0-422b-a4b8-602a91a301a5', 'd01a15ec-ba64-4bf2-b370-8fb04add701e', 'f5519d45-aa06-4037-a885-a82d39ebf1a6', '9795f877-57e6-4004-b5ef-48f6a3361ebc'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:00 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:00 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:00 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.339s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:00 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Deleted volume successfully. Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9ae66b81-0040-4c1d-93f9-435a17237461 tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-4b2ece1e-6c5d-4c87-a7bf-8bbabe61f8ee-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-f2033944-d885-4035-b8ba-c463989a7ef2-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-f2033944-d885-4035-b8ba-c463989a7ef2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-quobyte-2970bee1-caf4-49f8-81d8-123d78c6ffaf" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-2970bee1-caf4-49f8-81d8-123d78c6ffaf" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-quobyte-f2033944-d885-4035-b8ba-c463989a7ef2" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-f2033944-d885-4035-b8ba-c463989a7ef2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Deleting offline snapshot f2033944-d885-4035-b8ba-c463989a7ef2 of volume 2970bee1-caf4-49f8-81d8-123d78c6ffaf {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] snapshot_file for this snap is: volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87fec48-1a31-4c38-802f-3d8627f368e0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:01 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 Jul 24 15:50:01 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:02 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2" returned: 0 in 0.608s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:02 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[35722cf8-c89f-4792-bd98-a4a2ffacfbee]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:02 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf Jul 24 15:50:02 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:02 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf" returned: 0 in 0.575s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:02 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 Jul 24 15:50:02 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:03 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2" returned: 0 in 0.419s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:03 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2 Jul 24 15:50:03 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:03 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf.f2033944-d885-4035-b8ba-c463989a7ef2" returned: 0 in 0.320s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-f2033944-d885-4035-b8ba-c463989a7ef2" released by "_delete_snapshot" :: held 2.114s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-2970bee1-caf4-49f8-81d8-123d78c6ffaf" released by "delete_snapshot" :: held 2.147s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:03 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created reservations ['3474ae3b-dd36-48ef-8a7c-b3575a3e7c74', '710f12b3-6768-4ccf-9d2f-ddaa2c22587b', 'a543e346-1739-45ea-a2c3-8e645069de4c', '0a3b58fc-59de-45bd-beaf-85e6c8c83c9f'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:03 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Delete snapshot completed successfully. Jul 24 15:50:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-69e2b658-869a-493d-925c-730dede3474a tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-f2033944-d885-4035-b8ba-c463989a7ef2-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-2970bee1-caf4-49f8-81d8-123d78c6ffaf-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-2970bee1-caf4-49f8-81d8-123d78c6ffaf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "cinder-quobyte-2970bee1-caf4-49f8-81d8-123d78c6ffaf" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-2970bee1-caf4-49f8-81d8-123d78c6ffaf" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:05 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f8b3f-57ef-4807-872e-a24abdcc2b78]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:05 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf Jul 24 15:50:05 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:05 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf" returned: 0 in 0.512s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:05 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf Jul 24 15:50:05 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:05 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2970bee1-caf4-49f8-81d8-123d78c6ffaf" returned: 0 in 0.360s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-quobyte-2970bee1-caf4-49f8-81d8-123d78c6ffaf" released by "delete_volume" :: held 0.951s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Created reservations ['eada996a-8cd8-400f-bbc8-5c4b09b58e1b', 'eaae5d74-4e62-4fd1-8683-397788913aba', 'f92872ea-42bb-4efb-993a-b9433cd71a17', '5c2306d8-c806-4b31-9176-09aa4e6bfa94'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:06 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:06 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:06 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.319s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Deleted volume successfully. Jul 24 15:50:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-82602d96-0e6e-4686-a557-0b32d89eff6b tempest-CreateVolumesFromSnapshotTest-1815699629 None] Lock "cinder-2970bee1-caf4-49f8-81d8-123d78c6ffaf-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Flow 'volume_create_manager' (496713ad-d9cf-4050-907a-486b6c84f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a296001a-1106-428f-a670-c74e5eaa4d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a296001a-1106-428f-a670-c74e5eaa4d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1803143189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a3d2d2-3230-4a0f-85c1-318cf4175305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77247a0c943f46c997d771eabf7daccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:09Z,use_quota=True,user_id='6b6406ef88b94ec89a1a68f7a7f67242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d96a2f-eb35-4bf3-88be-d65b3b8ba4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d96a2f-eb35-4bf3-88be-d65b3b8ba4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a38c21e-6fac-427c-b2b6-c927072ffbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a38c21e-6fac-427c-b2b6-c927072ffbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a3d2d2-3230-4a0f-85c1-318cf4175305', 'volume_name': 'volume-77a3d2d2-3230-4a0f-85c1-318cf4175305', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c03d986-4bf0-4d62-abf3-1387d595b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c03d986-4bf0-4d62-abf3-1387d595b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c51be8-67bf-47f4-81c9-6c415a24fb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:08 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Volume 77a3d2d2-3230-4a0f-85c1-318cf4175305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a3d2d2-3230-4a0f-85c1-318cf4175305', 'volume_size': 1} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1803143189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a3d2d2-3230-4a0f-85c1-318cf4175305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77247a0c943f46c997d771eabf7daccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:09Z,use_quota=True,user_id='6b6406ef88b94ec89a1a68f7a7f67242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Creating volume 77a3d2d2-3230-4a0f-85c1-318cf4175305 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:08 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:08 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 1073741824 Jul 24 15:50:08 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:09 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 1073741824" returned: 0 in 0.730s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:09 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 Jul 24 15:50:09 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:10 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305" returned: 0 in 0.424s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c51be8-67bf-47f4-81c9-6c415a24fb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a3d2d2-3230-4a0f-85c1-318cf4175305', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b757844-e1f8-4e24-8ca2-d1314821f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:10 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Volume volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 (77a3d2d2-3230-4a0f-85c1-318cf4175305): created successfully Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b757844-e1f8-4e24-8ca2-d1314821f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Flow 'volume_create_manager' (496713ad-d9cf-4050-907a-486b6c84f214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:10 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-97486bdd-03e1-4661-9ea1-47d00cb1e976 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Created volume successfully. Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Acquiring lock "cinder-77a3d2d2-3230-4a0f-85c1-318cf4175305-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "cinder-77a3d2d2-3230-4a0f-85c1-318cf4175305-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Acquiring lock "cinder-quobyte-77a3d2d2-3230-4a0f-85c1-318cf4175305" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "cinder-quobyte-77a3d2d2-3230-4a0f-85c1-318cf4175305" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ea4970-a150-4f51-b498-bedff8377ebc]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:11 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 Jul 24 15:50:11 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:11 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305" returned: 0 in 0.478s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:11 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305 Jul 24 15:50:11 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:11 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-77a3d2d2-3230-4a0f-85c1-318cf4175305" returned: 0 in 0.355s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "cinder-quobyte-77a3d2d2-3230-4a0f-85c1-318cf4175305" released by "delete_volume" :: held 0.893s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:11 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Created reservations ['7e6ed4af-d735-42c0-9ad8-cbc8d04ff000', '1a4430a0-8f70-43e5-a62e-89c484dfa4b8', 'd7d82adf-dfb3-4166-80c8-db27b6453930', '62348675-80d4-4123-91a2-9e2347864f11'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:12 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:12 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (08345840-b83c-4c9c-904c-d838dbf4683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef463383-5906-4ec0-98fd-91ab8fd00a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.424s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef463383-5906-4ec0-98fd-91ab8fd00a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018869120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e15b39-6c1f-4ce1-97a0-5f16212df632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:12Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47767f37-2876-417d-a274-d834d4368125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47767f37-2876-417d-a274-d834d4368125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29f999f-8d98-431f-9d99-b7189b83d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29f999f-8d98-431f-9d99-b7189b83d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e15b39-6c1f-4ce1-97a0-5f16212df632', 'volume_name': 'volume-30e15b39-6c1f-4ce1-97a0-5f16212df632', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd45b374-7823-4e28-9c1e-77cf231c50aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd45b374-7823-4e28-9c1e-77cf231c50aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd44832-d3c3-43c5-b4c0-02b757b185a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume 30e15b39-6c1f-4ce1-97a0-5f16212df632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e15b39-6c1f-4ce1-97a0-5f16212df632', 'volume_size': 1} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018869120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e15b39-6c1f-4ce1-97a0-5f16212df632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:12Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Creating volume 30e15b39-6c1f-4ce1-97a0-5f16212df632 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:12 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Deleted volume successfully. Jul 24 15:50:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-49f042b8-a908-4fcc-baad-2a9fe81ab9ce tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "cinder-77a3d2d2-3230-4a0f-85c1-318cf4175305-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:12 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 1073741824 Jul 24 15:50:12 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Flow 'volume_create_manager' (75705908-c893-4dd0-9465-82cba978f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b582ee4e-db3b-4190-aeee-f2c47f95ebc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:13 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 1073741824" returned: 0 in 0.678s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b582ee4e-db3b-4190-aeee-f2c47f95ebc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1633125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999e2081-4692-4727-8bae-1dac4a1a3f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77247a0c943f46c997d771eabf7daccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:13Z,use_quota=True,user_id='6b6406ef88b94ec89a1a68f7a7f67242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2569b93b-3aa1-4b14-a71b-4842f1652498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2569b93b-3aa1-4b14-a71b-4842f1652498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977a0e13-5dac-4029-bd6e-99aa7d16b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977a0e13-5dac-4029-bd6e-99aa7d16b94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999e2081-4692-4727-8bae-1dac4a1a3f97', 'volume_name': 'volume-999e2081-4692-4727-8bae-1dac4a1a3f97', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610a1944-ee6e-4479-a622-921e0ad3f140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610a1944-ee6e-4479-a622-921e0ad3f140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edaa33bc-a760-4cb5-9771-d7ab63d9d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:13 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Volume 999e2081-4692-4727-8bae-1dac4a1a3f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999e2081-4692-4727-8bae-1dac4a1a3f97', 'volume_size': 1} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:13 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 Jul 24 15:50:13 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:13 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632" returned: 0 in 0.310s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1633125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999e2081-4692-4727-8bae-1dac4a1a3f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77247a0c943f46c997d771eabf7daccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:13Z,use_quota=True,user_id='6b6406ef88b94ec89a1a68f7a7f67242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Creating volume 999e2081-4692-4727-8bae-1dac4a1a3f97 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:13 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd44832-d3c3-43c5-b4c0-02b757b185a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e15b39-6c1f-4ce1-97a0-5f16212df632', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6033e3f-dbf5-480b-bbeb-f3e1735a84b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:13 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 1073741824 Jul 24 15:50:13 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:13 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 (30e15b39-6c1f-4ce1-97a0-5f16212df632): created successfully Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6033e3f-dbf5-480b-bbeb-f3e1735a84b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (08345840-b83c-4c9c-904c-d838dbf4683c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:13 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-58c35055-a343-4e44-8ed7-17866f7166d1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created volume successfully. Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Flow 'volume_create_manager' (48982af0-b495-49e6-bdc9-af17388021d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f62c4de-f027-4ebb-89dd-cfe7703da8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f62c4de-f027-4ebb-89dd-cfe7703da8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1868480369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0ff379-3f83-4399-bca6-04904eefb258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf2ab684e114d68ba28fb09f6867098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:14Z,use_quota=True,user_id='5f6cbbaa9288403ab011e24cb8086cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8722799f-5cd8-4912-af45-484c52f2ce39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8722799f-5cd8-4912-af45-484c52f2ce39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8597f87-6621-4e20-87e2-bdfc9a297bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8597f87-6621-4e20-87e2-bdfc9a297bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0ff379-3f83-4399-bca6-04904eefb258', 'volume_name': 'volume-eb0ff379-3f83-4399-bca6-04904eefb258', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1c2ab4-c1f2-4376-af91-977582064965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1c2ab4-c1f2-4376-af91-977582064965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:14 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e8d546-fda5-4d2b-a371-0b0e0eee0d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Volume eb0ff379-3f83-4399-bca6-04904eefb258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0ff379-3f83-4399-bca6-04904eefb258', 'volume_size': 1} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 1073741824" returned: 0 in 0.575s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:14 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 Jul 24 15:50:14 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:14 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97" returned: 0 in 0.298s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1868480369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0ff379-3f83-4399-bca6-04904eefb258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf2ab684e114d68ba28fb09f6867098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:14Z,use_quota=True,user_id='5f6cbbaa9288403ab011e24cb8086cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Creating volume eb0ff379-3f83-4399-bca6-04904eefb258 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:14 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edaa33bc-a760-4cb5-9771-d7ab63d9d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999e2081-4692-4727-8bae-1dac4a1a3f97', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7230c8a0-a515-4e95-bf09-76163c49f1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:14 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 1073741824 Jul 24 15:50:14 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Volume volume-999e2081-4692-4727-8bae-1dac4a1a3f97 (999e2081-4692-4727-8bae-1dac4a1a3f97): created successfully Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7230c8a0-a515-4e95-bf09-76163c49f1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Flow 'volume_create_manager' (75705908-c893-4dd0-9465-82cba978f728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-dc3a2817-b1e2-4097-93a9-848b7cc3db99 tempest-VolumeQuotasAdminTestJSON-1970510686 None] Created volume successfully. Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (6c388a49-0b7e-4236-a485-06711d481b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783b52b4-05e3-403f-94ff-26a3a66bebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783b52b4-05e3-403f-94ff-26a3a66bebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1469463182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f8fbfa-e588-41cb-83ac-6401e5cddb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:15Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1333ecdf-33f6-4e5b-9987-b929f09ca609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1333ecdf-33f6-4e5b-9987-b929f09ca609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d68562f-049e-465c-b42b-f65b4816e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d68562f-049e-465c-b42b-f65b4816e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f8fbfa-e588-41cb-83ac-6401e5cddb32', 'volume_name': 'volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92008f46-e95b-427a-8657-73fb0d9fa6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92008f46-e95b-427a-8657-73fb0d9fa6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4a23ae-fbe2-44d4-ba29-873b912f3f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume 04f8fbfa-e588-41cb-83ac-6401e5cddb32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32', 'volume_size': 1} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:15 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 1073741824" returned: 0 in 0.697s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:15 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 Jul 24 15:50:15 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (75bb03b6-51c4-4673-8fca-1b0c1ce37d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2f77b0-204f-4335-ad5e-070beecb59da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2f77b0-204f-4335-ad5e-070beecb59da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595663474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef0a234-48b5-4224-b178-ddfdcd6206b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:15Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95de0e3-1fdf-4753-b15d-7dbcfbe78885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95de0e3-1fdf-4753-b15d-7dbcfbe78885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193429d5-8e9b-4b52-aa81-03f39f21942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193429d5-8e9b-4b52-aa81-03f39f21942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef0a234-48b5-4224-b178-ddfdcd6206b5', 'volume_name': 'volume-bef0a234-48b5-4224-b178-ddfdcd6206b5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a2ffc9-e97b-47a2-b092-b0180c8f085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a2ffc9-e97b-47a2-b092-b0180c8f085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1460a94-9d00-4a5f-9835-a3e60a710fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:15 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume bef0a234-48b5-4224-b178-ddfdcd6206b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef0a234-48b5-4224-b178-ddfdcd6206b5', 'volume_size': 1} Jul 24 15:50:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:15 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258" returned: 0 in 0.489s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1469463182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f8fbfa-e588-41cb-83ac-6401e5cddb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:15Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Creating volume 04f8fbfa-e588-41cb-83ac-6401e5cddb32 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:16 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:16 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 1073741824 Jul 24 15:50:16 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (b41bf344-c46e-42f4-9cbd-4514e9e5896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ca4a3a-c925-4c2b-ace6-431eb6b07cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e8d546-fda5-4d2b-a371-0b0e0eee0d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0ff379-3f83-4399-bca6-04904eefb258', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c10286-2708-409a-ae6c-2cdc2d70a526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ca4a3a-c925-4c2b-ace6-431eb6b07cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278558370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260fb759-7170-4529-a164-2cd865e2466c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:16Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b25fb9d-445d-4663-a89f-e55506030452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b25fb9d-445d-4663-a89f-e55506030452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cbc290-aeda-44b9-87cf-b55bae3252d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cbc290-aeda-44b9-87cf-b55bae3252d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260fb759-7170-4529-a164-2cd865e2466c', 'volume_name': 'volume-260fb759-7170-4529-a164-2cd865e2466c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a50ecf-20b8-46b1-9ec6-7bd7fa724787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a50ecf-20b8-46b1-9ec6-7bd7fa724787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2787839-90b2-4bd0-bc0c-7b89e496bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume 260fb759-7170-4529-a164-2cd865e2466c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260fb759-7170-4529-a164-2cd865e2466c', 'volume_size': 1} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:16 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Volume volume-eb0ff379-3f83-4399-bca6-04904eefb258 (eb0ff379-3f83-4399-bca6-04904eefb258): created successfully Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c10286-2708-409a-ae6c-2cdc2d70a526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Flow 'volume_create_manager' (48982af0-b495-49e6-bdc9-af17388021d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fca0c239-73aa-4a30-86a4-bcd23cf61813 tempest-TestImageHashVerification-362451268 None] Created volume successfully. Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (79fb095b-4361-4f89-83fa-cbd1017e9a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403d1690-f3c0-4916-aed4-1b9b6d950e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403d1690-f3c0-4916-aed4-1b9b6d950e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1047839261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc866361-3b58-43d3-bf3c-259070c02e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:17Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86d607f-89b5-4779-80c4-f17eb8b5acab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86d607f-89b5-4779-80c4-f17eb8b5acab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f730cb7e-0a43-4328-86f1-cb554b6ab882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f730cb7e-0a43-4328-86f1-cb554b6ab882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc866361-3b58-43d3-bf3c-259070c02e20', 'volume_name': 'volume-bc866361-3b58-43d3-bf3c-259070c02e20', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33626614-65ab-423a-b4b5-b7524711b932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33626614-65ab-423a-b4b5-b7524711b932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148e16f5-2378-41c6-9f06-2d0c321b73ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:16 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume bc866361-3b58-43d3-bf3c-259070c02e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc866361-3b58-43d3-bf3c-259070c02e20', 'volume_size': 1} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 1073741824" returned: 0 in 0.730s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-43b1ed4b-3be9-420a-abb0-bfd2d35bd78f tempest-VolumeQuotasAdminTestJSON-1572376937 None] Transfer volume completed successfully. Jul 24 15:50:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:16 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 Jul 24 15:50:16 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:17 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32" returned: 0 in 0.455s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595663474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef0a234-48b5-4224-b178-ddfdcd6206b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:15Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Creating volume bef0a234-48b5-4224-b178-ddfdcd6206b5 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:17 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:17 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 1073741824 Jul 24 15:50:17 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (b808818d-66ea-4c50-ba40-4ef5beab3e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9151c13-8520-47f6-9612-6ad57078fe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4a23ae-fbe2-44d4-ba29-873b912f3f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de3b302-a6e2-43f8-97dc-2b623ee6f0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9151c13-8520-47f6-9612-6ad57078fe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1840018019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b934a9cf-1779-45bc-80fd-b9cd8f338554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:17Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e477c54-555d-446a-a085-4b83b58a5ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e477c54-555d-446a-a085-4b83b58a5ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7e98f6-ed73-4779-9ea2-c3f1021b9434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7e98f6-ed73-4779-9ea2-c3f1021b9434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b934a9cf-1779-45bc-80fd-b9cd8f338554', 'volume_name': 'volume-b934a9cf-1779-45bc-80fd-b9cd8f338554', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b9e7a2-26e6-47d9-b227-91c2a81d32c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b9e7a2-26e6-47d9-b227-91c2a81d32c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdde078-694e-4990-9610-cf21b6c420b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:17 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume b934a9cf-1779-45bc-80fd-b9cd8f338554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b934a9cf-1779-45bc-80fd-b9cd8f338554', 'volume_size': 1} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:17 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 (04f8fbfa-e588-41cb-83ac-6401e5cddb32): created successfully Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de3b302-a6e2-43f8-97dc-2b623ee6f0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (6c388a49-0b7e-4236-a485-06711d481b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:17 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2300d784-3d03-4e25-bc10-b2ec241bf857 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created volume successfully. Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Acquiring lock "cinder-999e2081-4692-4727-8bae-1dac4a1a3f97-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Lock "cinder-999e2081-4692-4727-8bae-1dac4a1a3f97-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Acquiring lock "cinder-quobyte-999e2081-4692-4727-8bae-1dac4a1a3f97" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Lock "cinder-quobyte-999e2081-4692-4727-8bae-1dac4a1a3f97" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3644955-d05e-47ed-aa29-7fd975dd3eb9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:17 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 Jul 24 15:50:17 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:17 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 1073741824" returned: 0 in 0.652s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:18 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 Jul 24 15:50:18 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:18 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97" returned: 0 in 0.454s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:18 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97 Jul 24 15:50:18 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:18 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5" returned: 0 in 0.369s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.123s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278558370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260fb759-7170-4529-a164-2cd865e2466c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:16Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Creating volume 260fb759-7170-4529-a164-2cd865e2466c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:18 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1460a94-9d00-4a5f-9835-a3e60a710fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef0a234-48b5-4224-b178-ddfdcd6206b5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:18 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c 1073741824 Jul 24 15:50:18 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ff2430-0685-4dd6-a70b-b313a9a82587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:18 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 (bef0a234-48b5-4224-b178-ddfdcd6206b5): created successfully Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ff2430-0685-4dd6-a70b-b313a9a82587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (75bb03b6-51c4-4673-8fca-1b0c1ce37d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8ee7d1b7-3261-4044-8a07-790eb9cf1b0c tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created volume successfully. Jul 24 15:50:18 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-999e2081-4692-4727-8bae-1dac4a1a3f97" returned: 0 in 0.357s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Lock "cinder-quobyte-999e2081-4692-4727-8bae-1dac4a1a3f97" released by "delete_volume" :: held 0.875s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Created reservations ['4b16418d-9687-4410-87f3-1201f715c964', 'c02e1e10-711d-43cf-9253-e8afa2875ef4', '358557e3-e527-4346-a379-44eebefda12f', '03b5668d-7653-49f7-be6d-13974e686b54'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:18 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:18 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:18 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c 1073741824" returned: 0 in 0.593s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:19 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.312s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:19 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Deleted volume successfully. Jul 24 15:50:19 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c Jul 24 15:50:19 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-801f9553-ff78-45c5-b1ee-4474fc0e4a4b tempest-VolumeQuotasAdminTestJSON-1924718956 None] Lock "cinder-999e2081-4692-4727-8bae-1dac4a1a3f97-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:19 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c" returned: 0 in 0.335s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.613s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1047839261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc866361-3b58-43d3-bf3c-259070c02e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:17Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Creating volume bc866361-3b58-43d3-bf3c-259070c02e20 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:19 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2787839-90b2-4bd0-bc0c-7b89e496bad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260fb759-7170-4529-a164-2cd865e2466c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61ed55f-6254-40e2-808a-d25fd998cb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:19 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 1073741824 Jul 24 15:50:19 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:19 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume volume-260fb759-7170-4529-a164-2cd865e2466c (260fb759-7170-4529-a164-2cd865e2466c): created successfully Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61ed55f-6254-40e2-808a-d25fd998cb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (b41bf344-c46e-42f4-9cbd-4514e9e5896b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:19 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b42c9bbc-7399-49ac-85e6-dd538097fd59 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created volume successfully. Jul 24 15:50:19 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 1073741824" returned: 0 in 0.563s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:20 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 Jul 24 15:50:20 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:20 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20" returned: 0 in 0.316s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.875s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1840018019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b934a9cf-1779-45bc-80fd-b9cd8f338554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ed8e64f3614ba9aa13b3a3f3be2b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:17Z,use_quota=True,user_id='0c0d65ff18bc466c9686e0f897b92d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Creating volume b934a9cf-1779-45bc-80fd-b9cd8f338554 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:20 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148e16f5-2378-41c6-9f06-2d0c321b73ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc866361-3b58-43d3-bf3c-259070c02e20', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46906fa1-0f90-41a5-a81b-4cba5687540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:20 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 1073741824 Jul 24 15:50:20 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:20 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume volume-bc866361-3b58-43d3-bf3c-259070c02e20 (bc866361-3b58-43d3-bf3c-259070c02e20): created successfully Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46906fa1-0f90-41a5-a81b-4cba5687540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (79fb095b-4361-4f89-83fa-cbd1017e9a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:20 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c0187da0-6338-4d8e-8428-e47f7e99efb1 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created volume successfully. Jul 24 15:50:20 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 1073741824" returned: 0 in 0.607s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:21 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 Jul 24 15:50:21 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:21 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554" returned: 0 in 0.316s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.858s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdde078-694e-4990-9610-cf21b6c420b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b934a9cf-1779-45bc-80fd-b9cd8f338554', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b196c5fa-bdd4-4203-84d2-a3dc112ab75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d7351e-c1bf-408d-a052-8294524505e6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Volume volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 (b934a9cf-1779-45bc-80fd-b9cd8f338554): created successfully Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b196c5fa-bdd4-4203-84d2-a3dc112ab75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Flow 'volume_create_manager' (b808818d-66ea-4c50-ba40-4ef5beab3e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:21 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-728ec0a9-b63d-460a-96c7-06a3050cf48a tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created volume successfully. Jul 24 15:50:21 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 Jul 24 15:50:21 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:21 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258" returned: 0 in 0.517s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211cd3b-3ec4-49a4-af5b-1c87f9a6f031]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-b934a9cf-1779-45bc-80fd-b9cd8f338554-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-b934a9cf-1779-45bc-80fd-b9cd8f338554-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:22 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 Jul 24 15:50:22 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-quobyte-b934a9cf-1779-45bc-80fd-b9cd8f338554" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-b934a9cf-1779-45bc-80fd-b9cd8f338554" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[02208172-de4d-4794-922a-fb6b821e7df0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:22 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 Jul 24 15:50:22 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:22 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258" returned: 0 in 0.508s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 /opt/stack/data/cinder/conversion/eb0ff379-3f83-4399-bca6-04904eefb258.temp_image.148fdc1d-5099-4deb-8cf4-5096a8f4760db_4iiaqc.img {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:22 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 /opt/stack/data/cinder/conversion/eb0ff379-3f83-4399-bca6-04904eefb258.temp_image.148fdc1d-5099-4deb-8cf4-5096a8f4760db_4iiaqc.img Jul 24 15:50:22 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:22 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554" returned: 0 in 0.611s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:22 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554 Jul 24 15:50:22 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:23 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b934a9cf-1779-45bc-80fd-b9cd8f338554" returned: 0 in 0.756s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-b934a9cf-1779-45bc-80fd-b9cd8f338554" released by "delete_volume" :: held 1.465s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:23 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created reservations ['05d2284b-3a4b-40e0-a63c-19300c8b922a', '2a59d6dc-b353-4393-b388-d3549f057fec', '0919fde7-3aa1-4116-9f64-b48d90d6e22a', '624cfde5-bbb1-43e0-bff2-5d3b4b2831b3'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:24 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:24 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-bc866361-3b58-43d3-bf3c-259070c02e20-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-bc866361-3b58-43d3-bf3c-259070c02e20-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-quobyte-bc866361-3b58-43d3-bf3c-259070c02e20" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-bc866361-3b58-43d3-bf3c-259070c02e20" acquired by "delete_volume" :: waited 0.041s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:25 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 1.007s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:25 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:25 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba25902-e8aa-4ade-8337-4cbf7d56ab9d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Deleted volume successfully. Jul 24 15:50:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f8d4c20-e7cb-4ec8-8bcb-3ba36605098b tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-b934a9cf-1779-45bc-80fd-b9cd8f338554-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:25 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 Jul 24 15:50:25 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:26 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20" returned: 0 in 1.243s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:26 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20 Jul 24 15:50:26 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:26 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bc866361-3b58-43d3-bf3c-259070c02e20" returned: 0 in 0.608s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-bc866361-3b58-43d3-bf3c-259070c02e20" released by "delete_volume" :: held 1.979s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created reservations ['44e54ecb-2b40-41ef-ad30-e225ef22fbb7', '375e288d-def4-4bd1-980f-bf65103218aa', '2ed2b2b6-8bf9-45eb-b8cb-ea9431fafeaa', '9f388565-1cc6-4eda-898d-4dc2d4abe0d6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:27 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:27 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:27 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.426s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Deleted volume successfully. Jul 24 15:50:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d0ea76e4-7962-4e7b-8c9f-475056709814 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-bc866361-3b58-43d3-bf3c-259070c02e20-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-260fb759-7170-4529-a164-2cd865e2466c-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-260fb759-7170-4529-a164-2cd865e2466c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-quobyte-260fb759-7170-4529-a164-2cd865e2466c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-260fb759-7170-4529-a164-2cd865e2466c" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:28 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 /opt/stack/data/cinder/conversion/eb0ff379-3f83-4399-bca6-04904eefb258.temp_image.148fdc1d-5099-4deb-8cf4-5096a8f4760db_4iiaqc.img" returned: 0 in 6.202s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48385ff-a9ee-4874-aeff-3ad9225350fd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ac596b-a16c-4e3f-a532-f97c366863ab]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:28 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c Jul 24 15:50:28 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:28 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 Jul 24 15:50:28 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:29 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c" returned: 0 in 0.423s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:29 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c Jul 24 15:50:29 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:29 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258" returned: 0 in 0.708s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/conversion/eb0ff379-3f83-4399-bca6-04904eefb258.temp_image.148fdc1d-5099-4deb-8cf4-5096a8f4760db_4iiaqc.img {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:50:29 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Converted 1024.00 MB image at 165.08 MB/s Jul 24 15:50:29 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] 148fdc1d-5099-4deb-8cf4-5096a8f4760d was raw, no need to convert to raw {{(pid=88251) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-260fb759-7170-4529-a164-2cd865e2466c" returned: 0 in 0.325s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-260fb759-7170-4529-a164-2cd865e2466c" released by "delete_volume" :: held 0.818s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created reservations ['7a364939-b651-4953-9f37-741dc44e272f', '27ded500-30d7-4ec9-bc84-3e96fb5c75e1', 'b59642ff-3f7c-447b-af53-d66f73998a5e', '31eac300-9b91-4855-b5d2-413842324502'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:29 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:29 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-bef0a234-48b5-4224-b178-ddfdcd6206b5-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-bef0a234-48b5-4224-b178-ddfdcd6206b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-quobyte-bef0a234-48b5-4224-b178-ddfdcd6206b5" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-bef0a234-48b5-4224-b178-ddfdcd6206b5" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b4821f-0a56-4f74-a7e6-494b8dc9c717]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:29 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.432s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Deleted volume successfully. Jul 24 15:50:30 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 Jul 24 15:50:30 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-364cad44-1992-41b0-a9e4-e036a9c7eb33 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-260fb759-7170-4529-a164-2cd865e2466c-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:30 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5" returned: 0 in 0.406s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:30 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5 Jul 24 15:50:30 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:30 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bef0a234-48b5-4224-b178-ddfdcd6206b5" returned: 0 in 0.285s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-bef0a234-48b5-4224-b178-ddfdcd6206b5" released by "delete_volume" :: held 0.758s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created reservations ['51e6917f-f0f4-4195-8e40-c26e1c46440c', 'b9e4b9d8-e39b-4c9f-bb21-d3b22a34217d', '62043fe2-ad79-49f6-8280-07a63801aefc', '0979ebfa-bd35-410c-bdd1-a66723482a72'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:30 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:30 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:31 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.347s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Deleted volume successfully. Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-adf0989c-6072-4cb1-a4ad-b03fd81a0694 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-bef0a234-48b5-4224-b178-ddfdcd6206b5-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-04f8fbfa-e588-41cb-83ac-6401e5cddb32-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-04f8fbfa-e588-41cb-83ac-6401e5cddb32-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-quobyte-04f8fbfa-e588-41cb-83ac-6401e5cddb32" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-04f8fbfa-e588-41cb-83ac-6401e5cddb32" acquired by "delete_volume" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[579211d5-9498-4855-8c73-59f495faa015]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Flow 'volume_create_manager' (4ab1b0b6-bf82-44f5-8b86-0b429e0435e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f620dd-5d9a-4123-bffa-c734fa86ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f620dd-5d9a-4123-bffa-c734fa86ace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-318099836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3405a1ba-f83a-4668-bc97-370b28879302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42b0add06624d04b589e7c01c3218f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:31Z,use_quota=True,user_id='4552095705134fb99e40cb199bbe938b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dfc3f7-e34f-49f0-b76b-05ae41f2c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dfc3f7-e34f-49f0-b76b-05ae41f2c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee973fee-2e0a-4291-aee4-5125017f1ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee973fee-2e0a-4291-aee4-5125017f1ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3405a1ba-f83a-4668-bc97-370b28879302', 'volume_name': 'volume-3405a1ba-f83a-4668-bc97-370b28879302', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efa95aa-5863-4e9d-9382-441657510672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efa95aa-5863-4e9d-9382-441657510672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf7ca3b-36c1-48dd-8892-a16e2ba8288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:31 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Volume 3405a1ba-f83a-4668-bc97-370b28879302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3405a1ba-f83a-4668-bc97-370b28879302', 'volume_size': 1} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:31 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 Jul 24 15:50:31 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:31 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32" returned: 0 in 0.502s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:31 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32 Jul 24 15:50:31 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Flow 'volume_create_manager' (e3bf7a8e-e8d5-4e0a-a123-06b36a50e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44caf9cb-f03f-4d23-b20f-e6d4fba4a069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44caf9cb-f03f-4d23-b20f-e6d4fba4a069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1408211069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0297e2-1bdb-4dd3-9f3a-204bf31536d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8f52b5fab2449bbc95bb6b5a1cf34b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:32Z,use_quota=True,user_id='f72d587651594aa080ed4f131ecec562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd5212c1-e6c6-4218-a3a7-88a2b9ca6b48),volume_type_id=fd5212c1-e6c6-4218-a3a7-88a2b9ca6b48)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785d9e05-b183-40aa-a30a-f7f42667bd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785d9e05-b183-40aa-a30a-f7f42667bd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30741b6b-7456-4fed-92aa-d9d8626d5a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30741b6b-7456-4fed-92aa-d9d8626d5a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0297e2-1bdb-4dd3-9f3a-204bf31536d2', 'volume_name': 'volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3610bd3d-809f-47fd-969b-cdf1533be99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3610bd3d-809f-47fd-969b-cdf1533be99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d28cca-5bf8-4a20-93c7-4c8f47fea93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:32 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Volume 7f0297e2-1bdb-4dd3-9f3a-204bf31536d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2', 'volume_size': 1} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:32 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04f8fbfa-e588-41cb-83ac-6401e5cddb32" returned: 0 in 0.330s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-04f8fbfa-e588-41cb-83ac-6401e5cddb32" released by "delete_volume" :: held 0.913s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created reservations ['c51bbd12-8d12-4d00-9caf-91c04194faed', '33917d08-a813-4c33-98f6-44cbf170ef69', 'dd6e0a1e-8e9e-49a0-831f-0a4d3cbe5df5', 'dce67a67-d8c0-47bb-8b51-b9012d0dbdcd'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:32 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:32 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-30e15b39-6c1f-4ce1-97a0-5f16212df632-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-30e15b39-6c1f-4ce1-97a0-5f16212df632-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "cinder-quobyte-30e15b39-6c1f-4ce1-97a0-5f16212df632" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-30e15b39-6c1f-4ce1-97a0-5f16212df632" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1c264b-60ce-4669-8de9-b4a40285cbe9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:32 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.338s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Deleted volume successfully. Jul 24 15:50:32 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 Jul 24 15:50:32 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-27489fb5-224f-4387-9ff5-61b61ea80571 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-04f8fbfa-e588-41cb-83ac-6401e5cddb32-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:33 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632" returned: 0 in 0.411s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:33 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632 Jul 24 15:50:33 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:33 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-30e15b39-6c1f-4ce1-97a0-5f16212df632" returned: 0 in 0.271s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-quobyte-30e15b39-6c1f-4ce1-97a0-5f16212df632" released by "delete_volume" :: held 0.741s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Created reservations ['4ada1735-8e19-4958-a024-94e09f6272e9', '98320cb2-1f25-47cf-9945-c96f5f4f81af', 'a5dc3416-955e-4ab4-9266-fd9f0c31ade0', 'a954befc-c9de-49b3-9e27-9e874a35b0f5'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:33 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:33 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:33 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:33 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Deleted volume successfully. Jul 24 15:50:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-588fbf32-222c-4565-ac9f-0e61c949cd42 tempest-CreateVolumesFromSourceVolumeTest-1372782672 None] Lock "cinder-30e15b39-6c1f-4ce1-97a0-5f16212df632-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:50:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:34 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:34 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:35 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.372s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:50:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:50:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=208,cinder:SELECT=142,cinder:INSERT=41,cinder:DELETE=18 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=150,cinder:UPDATE=211,cinder:INSERT=54,cinder:DELETE=11 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Flow 'volume_create_manager' (675d24f9-e02e-4c09-baa2-2d56adc99807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb990be8-39d2-42d5-9628-8f635066b37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb990be8-39d2-42d5-9628-8f635066b37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1583942856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c429cdf7-66e6-47d1-b431-0c710077c969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6cd9a9a5514004ab1784cc1e9d271e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:37Z,use_quota=True,user_id='74e08422ea0b4e0295f904009547e081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4026ff3d-cd71-4695-9aa8-8ba5743bba95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4026ff3d-cd71-4695-9aa8-8ba5743bba95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e8871e-41eb-45ad-8fcb-603a6ed61a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e8871e-41eb-45ad-8fcb-603a6ed61a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c429cdf7-66e6-47d1-b431-0c710077c969', 'volume_name': 'volume-c429cdf7-66e6-47d1-b431-0c710077c969', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1852ae5-ce80-41e6-a98c-42bd44f297f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1852ae5-ce80-41e6-a98c-42bd44f297f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f494b8a0-2e76-49b5-a1de-4cf32d392f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:37 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Volume c429cdf7-66e6-47d1-b431-0c710077c969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c429cdf7-66e6-47d1-b431-0c710077c969', 'volume_size': 1} Jul 24 15:50:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:47 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.753s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Uploaded volume to glance image-id: 148fdc1d-5099-4deb-8cf4-5096a8f4760d. {{(pid=88251) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.526s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-318099836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3405a1ba-f83a-4668-bc97-370b28879302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42b0add06624d04b589e7c01c3218f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:31Z,use_quota=True,user_id='4552095705134fb99e40cb199bbe938b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Creating volume 3405a1ba-f83a-4668-bc97-370b28879302 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:50 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:50 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 1073741824 Jul 24 15:50:50 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bebb2054-4cc1-4ff1-8611-48aca2f46055 tempest-TestImageHashVerification-362451268 None] Copy volume to image completed successfully. Jul 24 15:50:50 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 1073741824" returned: 0 in 0.418s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:50 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 Jul 24 15:50:50 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:50 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302" returned: 0 in 0.251s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.628s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1408211069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0297e2-1bdb-4dd3-9f3a-204bf31536d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8f52b5fab2449bbc95bb6b5a1cf34b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:32Z,use_quota=True,user_id='f72d587651594aa080ed4f131ecec562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd5212c1-e6c6-4218-a3a7-88a2b9ca6b48),volume_type_id=fd5212c1-e6c6-4218-a3a7-88a2b9ca6b48)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Creating volume 7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:50 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf7ca3b-36c1-48dd-8892-a16e2ba8288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3405a1ba-f83a-4668-bc97-370b28879302', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df05d37-cfb7-453a-8d99-e1c7524b6fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:50 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 1073741824 Jul 24 15:50:50 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Volume volume-3405a1ba-f83a-4668-bc97-370b28879302 (3405a1ba-f83a-4668-bc97-370b28879302): created successfully Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df05d37-cfb7-453a-8d99-e1c7524b6fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Flow 'volume_create_manager' (4ab1b0b6-bf82-44f5-8b86-0b429e0435e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fafe2746-49e0-4860-a23f-b9ab24aa6b17 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Created volume successfully. Jul 24 15:50:51 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 1073741824" returned: 0 in 0.476s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:51 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 Jul 24 15:50:51 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:51 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2" returned: 0 in 0.287s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.197s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1583942856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c429cdf7-66e6-47d1-b431-0c710077c969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6cd9a9a5514004ab1784cc1e9d271e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:37Z,use_quota=True,user_id='74e08422ea0b4e0295f904009547e081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Creating volume c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:51 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:51 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 1073741824 Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d28cca-5bf8-4a20-93c7-4c8f47fea93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:51 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800ee953-6d1d-455e-86eb-e5fde051826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Volume volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 (7f0297e2-1bdb-4dd3-9f3a-204bf31536d2): created successfully Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800ee953-6d1d-455e-86eb-e5fde051826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Flow 'volume_create_manager' (e3bf7a8e-e8d5-4e0a-a123-06b36a50e231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-16ad3645-0d54-4899-8ed1-d3d71ae0a4cd tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Created volume successfully. Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Acquiring lock "cinder-eb0ff379-3f83-4399-bca6-04904eefb258-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Lock "cinder-eb0ff379-3f83-4399-bca6-04904eefb258-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Acquiring lock "cinder-quobyte-eb0ff379-3f83-4399-bca6-04904eefb258" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Lock "cinder-quobyte-eb0ff379-3f83-4399-bca6-04904eefb258" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a26613f-ba3e-4f1b-a8d6-d7ca07501e8e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:51 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 Jul 24 15:50:51 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 1073741824" returned: 0 in 0.506s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 Jul 24 15:50:52 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258" returned: 0 in 0.453s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258 Jul 24 15:50:52 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969" returned: 0 in 0.311s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f494b8a0-2e76-49b5-a1de-4cf32d392f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c429cdf7-66e6-47d1-b431-0c710077c969', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647072c0-ec9d-4749-9a5e-93598f4c894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:52 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Volume volume-c429cdf7-66e6-47d1-b431-0c710077c969 (c429cdf7-66e6-47d1-b431-0c710077c969): created successfully Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647072c0-ec9d-4749-9a5e-93598f4c894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Flow 'volume_create_manager' (675d24f9-e02e-4c09-baa2-2d56adc99807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-296693b4-20d7-4ad9-beb4-f04ee586c0b9 tempest-VolumeDependencyTests-1017767053 None] Created volume successfully. Jul 24 15:50:52 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb0ff379-3f83-4399-bca6-04904eefb258" returned: 0 in 0.353s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Lock "cinder-quobyte-eb0ff379-3f83-4399-bca6-04904eefb258" released by "delete_volume" :: held 0.854s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Created reservations ['8eac9cdc-ed1b-43f9-8404-06321df80059', '09499dc7-358e-426f-a1b6-7b5d0649a1a2', '75fbfe21-40a2-4911-a0eb-838eadb7e3fc', '4c226bab-49fa-49b6-8ca1-641ad5eca598'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_db.api [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Jul 24 15:50:52 devstack cinder-volume[88251]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Jul 24 15:50:52 devstack cinder-volume[88251]: FROM reservations Jul 24 15:50:52 devstack cinder-volume[88251]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE] Jul 24 15:50:52 devstack cinder-volume[88251]: [parameters: {'uuid_1_1': '8eac9cdc-ed1b-43f9-8404-06321df80059', 'uuid_1_2': '09499dc7-358e-426f-a1b6-7b5d0649a1a2', 'uuid_1_3': '75fbfe21-40a2-4911-a0eb-838eadb7e3fc', 'uuid_1_4': '4c226bab-49fa-49b6-8ca1-641ad5eca598'}] Jul 24 15:50:52 devstack cinder-volume[88251]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=88251) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_db.api [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=88251) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Acquiring lock "cinder-3405a1ba-f83a-4668-bc97-370b28879302-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:52 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "cinder-3405a1ba-f83a-4668-bc97-370b28879302-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Acquiring lock "cinder-quobyte-3405a1ba-f83a-4668-bc97-370b28879302" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "cinder-quobyte-3405a1ba-f83a-4668-bc97-370b28879302" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb08a59-2f9b-4fdf-896e-75bdf6cfaf92]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:53 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 Jul 24 15:50:53 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:53 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.281s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7bde21d5-4b50-49ff-8e7f-8bdf6975028a tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Retype volume completed successfully. Jul 24 15:50:53 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302" returned: 0 in 0.413s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:53 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302 Jul 24 15:50:53 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Creating offline snapshot 11894ccb-9528-44d8-8325-8a8d76bcc5f8 of volume c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[570479f5-b259-4f9a-94be-9e1467cda6a6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:53 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 Jul 24 15:50:53 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:53 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3405a1ba-f83a-4668-bc97-370b28879302" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "cinder-quobyte-3405a1ba-f83a-4668-bc97-370b28879302" released by "delete_volume" :: held 0.734s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Created reservations ['af302361-1029-498b-a3d3-ca930aacbd44', 'd1e2ba38-07b6-4234-b565-96c53ba2711c', 'e878e83a-f3a5-4c30-a3a9-1afe15609493', 'b62ade6f-26bc-40ee-82cd-30cbfc1e84ef'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:53 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:53 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:53 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:53 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:54 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969" returned: 0 in 0.530s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:54 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 1G Jul 24 15:50:54 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Acquiring lock "cinder-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "cinder-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Acquiring lock "cinder-quobyte-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "cinder-quobyte-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d2b825-c56f-4435-bcd4-770425debd63]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:54 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.447s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Deleted volume successfully. Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08da2fa0-1164-4ffe-9179-2e56ccc03e78 tempest-VolumeQuotasNegativeTestJSON-1635730185 None] Lock "cinder-3405a1ba-f83a-4668-bc97-370b28879302-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:54 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.512s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Deleted volume successfully. Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-376c7df2-37f5-4422-b1cb-9b5bc725e45b tempest-TestImageHashVerification-362451268 None] Lock "cinder-eb0ff379-3f83-4399-bca6-04904eefb258-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:54 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 Jul 24 15:50:54 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:54 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 1G" returned: 0 in 0.656s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c429cdf7-66e6-47d1-b431-0c710077c969 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:54 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c429cdf7-66e6-47d1-b431-0c710077c969 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 Jul 24 15:50:54 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:54 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2" returned: 0 in 0.568s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:54 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2 Jul 24 15:50:54 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:55 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c429cdf7-66e6-47d1-b431-0c710077c969 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8" returned: 0 in 0.400s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:55 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 is being set with open permissions: ugo+rw Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:55 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 Jul 24 15:50:55 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:55 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2" returned: 0 in 0.340s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "cinder-quobyte-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2" released by "delete_volume" :: held 0.971s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:55 devstack cinder-volume[88251]: WARNING cinder.quota [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:50:55 devstack cinder-volume[88251]: WARNING cinder.quota [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Created reservations ['cdc8cd92-5856-457f-a596-89ef6452fa71', 'abf26998-e477-4494-baa1-2805e6f1fb24', '92a384ac-1155-4da0-ad62-76fc4cb9bb8b', 'd0dfb76c-ad26-45a6-992b-447f92bd3741'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:55 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:50:55 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:55 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8" returned: 0 in 0.397s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:55 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.info Jul 24 15:50:55 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:55 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.313s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Deleted volume successfully. Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e36b603a-6ba5-4751-86e1-9cf95c2a48c6 tempest-VolumeRetypeWithoutMigrationTest-1399850638 None] Lock "cinder-7f0297e2-1bdb-4dd3-9f3a-204bf31536d2-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:55 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.info" returned: 0 in 0.349s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:55 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.info is being set with open permissions: ugo+rw Jul 24 15:50:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:55 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.info Jul 24 15:50:55 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:56 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.info" returned: 0 in 0.269s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b9518af3-be58-4b23-9217-f8d8eb8e5f38 tempest-VolumeDependencyTests-1017767053 None] Create snapshot completed successfully Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Flow 'volume_create_manager' (c4467e89-8f76-4228-8dfd-9e6714e3f518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4564161e-380f-4262-a9e4-9e05f37f6f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4564161e-380f-4262-a9e4-9e05f37f6f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1055061566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280b337c-a9e7-4b62-8280-1928372ef9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6cd9a9a5514004ab1784cc1e9d271e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11894ccb-9528-44d8-8325-8a8d76bcc5f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:57Z,use_quota=True,user_id='74e08422ea0b4e0295f904009547e081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef84178-7c01-4609-9ade-3c997df5e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef84178-7c01-4609-9ade-3c997df5e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66af8907-ece1-4379-a1e6-92112b0cf7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66af8907-ece1-4379-a1e6-92112b0cf7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '280b337c-a9e7-4b62-8280-1928372ef9b9', 'volume_name': 'volume-280b337c-a9e7-4b62-8280-1928372ef9b9', 'volume_size': 1, 'snapshot_id': '11894ccb-9528-44d8-8325-8a8d76bcc5f8'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579e4665-e5c7-40d8-a091-6f1a9180d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579e4665-e5c7-40d8-a091-6f1a9180d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a955bf-e117-464b-b0f9-6e8d9dbdc915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:57 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Volume 280b337c-a9e7-4b62-8280-1928372ef9b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-280b337c-a9e7-4b62-8280-1928372ef9b9', 'volume_size': 1, 'snapshot_id': '11894ccb-9528-44d8-8325-8a8d76bcc5f8'} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-quobyte-11894ccb-9528-44d8-8325-8a8d76bcc5f8-280b337c-a9e7-4b62-8280-1928372ef9b9" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-11894ccb-9528-44d8-8325-8a8d76bcc5f8-280b337c-a9e7-4b62-8280-1928372ef9b9" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Creating volume 280b337c-a9e7-4b62-8280-1928372ef9b9 from snapshot 11894ccb-9528-44d8-8325-8a8d76bcc5f8 {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-quobyte-280b337c-a9e7-4b62-8280-1928372ef9b9" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-280b337c-a9e7-4b62-8280-1928372ef9b9" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] snapshot: 11894ccb-9528-44d8-8325-8a8d76bcc5f8, volume: 280b337c-a9e7-4b62-8280-1928372ef9b9, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2436e125-d531-4616-b74d-b802022b32f4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:58 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 Jul 24 15:50:58 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:58 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8" returned: 0 in 0.473s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c429cdf7-66e6-47d1-b431-0c710077c969(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:50:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:50:58 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a33bc84-ed08-4549-b27a-4d77b006e7e1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:58 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 Jul 24 15:50:58 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:59 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969" returned: 0 in 0.575s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:59 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:50:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:59 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 Jul 24 15:50:59 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:04 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9" returned: 0 in 5.792s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:04 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f9dadf-c6d7-4924-9496-bf542cacc131]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:04 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 Jul 24 15:51:04 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:05 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969" returned: 0 in 0.596s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:51:05 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Converted 1024.00 MB image at 176.76 MB/s Jul 24 15:51:05 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 is being set with open permissions: ugo+rw Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:05 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 Jul 24 15:51:05 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:05 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-280b337c-a9e7-4b62-8280-1928372ef9b9" released by "_copy_volume_from_snapshot" :: held 7.902s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-11894ccb-9528-44d8-8325-8a8d76bcc5f8-280b337c-a9e7-4b62-8280-1928372ef9b9" released by "_create_volume_from_snapshot" :: held 7.969s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.988s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a955bf-e117-464b-b0f9-6e8d9dbdc915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280b337c-a9e7-4b62-8280-1928372ef9b9', 'volume_size': 1, 'snapshot_id': '11894ccb-9528-44d8-8325-8a8d76bcc5f8'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84003d12-ea37-427d-a225-1d62b6da7b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Volume volume-280b337c-a9e7-4b62-8280-1928372ef9b9 (280b337c-a9e7-4b62-8280-1928372ef9b9): created successfully Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84003d12-ea37-427d-a225-1d62b6da7b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Flow 'volume_create_manager' (c4467e89-8f76-4228-8dfd-9e6714e3f518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-91ffecf3-73bb-490a-aee7-23138c8dc117 tempest-VolumeDependencyTests-1017767053 None] Created volume successfully. Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-11894ccb-9528-44d8-8325-8a8d76bcc5f8-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-11894ccb-9528-44d8-8325-8a8d76bcc5f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-quobyte-c429cdf7-66e6-47d1-b431-0c710077c969" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-c429cdf7-66e6-47d1-b431-0c710077c969" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-quobyte-11894ccb-9528-44d8-8325-8a8d76bcc5f8" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-11894ccb-9528-44d8-8325-8a8d76bcc5f8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Deleting offline snapshot 11894ccb-9528-44d8-8325-8a8d76bcc5f8 of volume c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] snapshot_file for this snap is: volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[789ff438-e6ec-4cf9-977c-042521e0cc07]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:06 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 Jul 24 15:51:06 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:07 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8" returned: 0 in 0.486s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c429cdf7-66e6-47d1-b431-0c710077c969(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:51:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedafce6-2e18-4673-97c7-732408ce5b8e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:07 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 Jul 24 15:51:07 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:07 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969" returned: 0 in 0.540s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:07 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 Jul 24 15:51:07 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:08 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8" returned: 0 in 0.500s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:08 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8 Jul 24 15:51:08 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:08 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969.11894ccb-9528-44d8-8325-8a8d76bcc5f8" returned: 0 in 0.319s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-11894ccb-9528-44d8-8325-8a8d76bcc5f8" released by "_delete_snapshot" :: held 2.001s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-c429cdf7-66e6-47d1-b431-0c710077c969" released by "delete_snapshot" :: held 2.036s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:08 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Created reservations ['690fc683-52c9-4665-bf9a-ac2f65cd61c1', '2ac4f11c-d906-4c46-96ed-6f6b83d57902', '87a94db4-3a38-4f3e-8e1a-824681e76036', '4814cd1f-c0cd-4585-9ac0-45d0f3bd8a46'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:08 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Delete snapshot completed successfully. Jul 24 15:51:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cd73338d-4dd7-4b7c-8b28-901d30d3263f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-11894ccb-9528-44d8-8325-8a8d76bcc5f8-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-c429cdf7-66e6-47d1-b431-0c710077c969-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-c429cdf7-66e6-47d1-b431-0c710077c969-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-quobyte-c429cdf7-66e6-47d1-b431-0c710077c969" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-c429cdf7-66e6-47d1-b431-0c710077c969" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:09 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cab0d54-750e-4cfc-859f-f049ec881246]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:10 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 Jul 24 15:51:10 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:10 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969" returned: 0 in 0.540s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:10 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969 Jul 24 15:51:10 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Flow 'volume_create_manager' (2e06e874-88c1-4ee8-b2f9-126a2c9d5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e1aa49-1d0a-4a6e-bbfc-08e5cc168d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e1aa49-1d0a-4a6e-bbfc-08e5cc168d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1593103218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00fb926-47fe-4068-8ec9-962ce4d8df57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066fe050f0ff49d885ab9412cdcf8514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:10Z,use_quota=True,user_id='8a62e67c49014b1fbdd2201c60bc6e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a43f6f8-a4fa-4d0e-91f6-353c33a1da12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a43f6f8-a4fa-4d0e-91f6-353c33a1da12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03a4719-9f3a-4dd6-b88a-deb6e0519d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03a4719-9f3a-4dd6-b88a-deb6e0519d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00fb926-47fe-4068-8ec9-962ce4d8df57', 'volume_name': 'volume-d00fb926-47fe-4068-8ec9-962ce4d8df57', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ff78ad-a113-4ec3-a799-b65bb4762e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ff78ad-a113-4ec3-a799-b65bb4762e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80699df-85ee-4264-8deb-159c8f5aa8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:10 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Volume d00fb926-47fe-4068-8ec9-962ce4d8df57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00fb926-47fe-4068-8ec9-962ce4d8df57', 'volume_size': 1} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1593103218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00fb926-47fe-4068-8ec9-962ce4d8df57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066fe050f0ff49d885ab9412cdcf8514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:10Z,use_quota=True,user_id='8a62e67c49014b1fbdd2201c60bc6e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Creating volume d00fb926-47fe-4068-8ec9-962ce4d8df57 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:10 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:10 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 1073741824 Jul 24 15:51:10 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:10 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c429cdf7-66e6-47d1-b431-0c710077c969" returned: 0 in 0.439s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-c429cdf7-66e6-47d1-b431-0c710077c969" released by "delete_volume" :: held 1.086s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Created reservations ['2784c02e-0273-4c15-ac18-984036d79434', '8b8a6326-54c1-4df7-afbd-7d67c85c3c29', '102895a2-b566-4ef3-b205-0340f86fbd30', 'cbaa0082-2cff-48c2-852c-148cca162fbc'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:11 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:11 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:11 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 1073741824" returned: 0 in 0.696s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:11 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 Jul 24 15:51:11 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:11 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.547s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:11 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Deleted volume successfully. Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a3873069-f456-4d99-af35-92d5fb12f84a tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-c429cdf7-66e6-47d1-b431-0c710077c969-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:11 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57" returned: 0 in 0.441s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80699df-85ee-4264-8deb-159c8f5aa8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00fb926-47fe-4068-8ec9-962ce4d8df57', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c928a43d-5219-4022-a9ee-5a553e0ff6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:12 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Volume volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 (d00fb926-47fe-4068-8ec9-962ce4d8df57): created successfully Jul 24 15:51:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c928a43d-5219-4022-a9ee-5a553e0ff6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Flow 'volume_create_manager' (2e06e874-88c1-4ee8-b2f9-126a2c9d5245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ee7f21f6-03de-4bf2-838c-5f31acd19c61 tempest-VolumesServicesTestJSON-639385530 None] Created volume successfully. Jul 24 15:51:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-280b337c-a9e7-4b62-8280-1928372ef9b9-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-280b337c-a9e7-4b62-8280-1928372ef9b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "cinder-quobyte-280b337c-a9e7-4b62-8280-1928372ef9b9" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-280b337c-a9e7-4b62-8280-1928372ef9b9" acquired by "delete_volume" :: waited 0.032s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:12 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a216e793-ff43-4566-9cb3-dc0a33d2ffc4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:12 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 Jul 24 15:51:12 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Acquiring lock "cinder-d00fb926-47fe-4068-8ec9-962ce4d8df57-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Lock "cinder-d00fb926-47fe-4068-8ec9-962ce4d8df57-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:13 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9" returned: 0 in 0.649s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:13 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9 Jul 24 15:51:13 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Acquiring lock "cinder-quobyte-d00fb926-47fe-4068-8ec9-962ce4d8df57" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Lock "cinder-quobyte-d00fb926-47fe-4068-8ec9-962ce4d8df57" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f21524e-8cdd-4b79-a26a-bb838d031de8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:13 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 Jul 24 15:51:13 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:13 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-280b337c-a9e7-4b62-8280-1928372ef9b9" returned: 0 in 0.381s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-quobyte-280b337c-a9e7-4b62-8280-1928372ef9b9" released by "delete_volume" :: held 1.091s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Created reservations ['a7f55517-7cd1-452b-96d7-890dbb1934d8', '16578528-1ed4-43ff-ab80-219e1bc40e58', '6183150a-69bb-499e-8e99-268662e0fe61', 'ba018840-ae51-4bb0-993e-23eca3b490c6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:13 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:13 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:13 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57" returned: 0 in 0.594s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:13 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57 Jul 24 15:51:13 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:14 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.417s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:14 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Deleted volume successfully. Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d00fb926-47fe-4068-8ec9-962ce4d8df57" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Lock "cinder-quobyte-d00fb926-47fe-4068-8ec9-962ce4d8df57" released by "delete_volume" :: held 1.023s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-96cde2fe-8dec-4068-9a6b-e3f5d5b6f02f tempest-VolumeDependencyTests-1017767053 None] Lock "cinder-280b337c-a9e7-4b62-8280-1928372ef9b9-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Created reservations ['90108eac-619c-4efd-b398-d2164fc3fe3c', '275cfe17-bb35-4d6d-9725-9d5d6375caa1', '65acaa8b-16ee-4724-a656-339b1263cefc', '338c278a-d540-41c6-90f1-df85fe5028b4'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:14 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:14 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:14 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.399s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Deleted volume successfully. Jul 24 15:51:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ccb8e73d-49a7-4850-86d5-845bdfd6ffde tempest-VolumesServicesTestJSON-639385530 None] Lock "cinder-d00fb926-47fe-4068-8ec9-962ce4d8df57-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:18 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Flow 'volume_create_manager' (ce7290c3-9d80-428f-9262-5185a84a3676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb18303-cede-4207-b00a-3442bb61622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb18303-cede-4207-b00a-3442bb61622b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b60476-7a3c-4d48-9fc7-c862c50d8f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b1950a1f90439cb10383d6ea64ef70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:19Z,use_quota=True,user_id='07940bc73ea74554a1a31f422723b751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa68e41e-0b37-47af-93ee-72ffdc47041d),volume_type_id=aa68e41e-0b37-47af-93ee-72ffdc47041d)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62abb849-7749-4744-9b35-500c0b03da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62abb849-7749-4744-9b35-500c0b03da80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acb1e7c-1a1c-46bc-b1f4-9b81720b7a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acb1e7c-1a1c-46bc-b1f4-9b81720b7a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17b60476-7a3c-4d48-9fc7-c862c50d8f89', 'volume_name': 'volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89', 'volume_size': 1, 'image_id': '8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8988ca9d15ac2fd1ee3e59bd816ea9bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41b1950a1f90439cb10383d6ea64ef70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b92251dea454c42e4620d1a1c0723ca282c0ca72465b2fbbb43b43b75f870530f68d2ce94da35922c078082f3b848e1182bd90db26304a2b00ea88cb7efc032a', 'id': '8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'created_at': datetime.datetime(2026, 7, 24, 13, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71781f9-a6d7-40c1-a230-4f4df8626142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71781f9-a6d7-40c1-a230-4f4df8626142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdc799e-2ba9-40ed-ac45-49fbe7e8f0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:19 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Volume 17b60476-7a3c-4d48-9fc7-c862c50d8f89: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89', 'volume_size': 1, 'image_id': '8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8988ca9d15ac2fd1ee3e59bd816ea9bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41b1950a1f90439cb10383d6ea64ef70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b92251dea454c42e4620d1a1c0723ca282c0ca72465b2fbbb43b43b75f870530f68d2ce94da35922c078082f3b848e1182bd90db26304a2b00ea88cb7efc032a', 'id': '8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'created_at': datetime.datetime(2026, 7, 24, 13, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 24 15:51:19 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Trying to clone 17b60476-7a3c-4d48-9fc7-c862c50d8f89 from image 8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:51:20 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Image download 0.00 MB at 0.00 MB/s Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa85983-85e8-45e8-8c2c-ca5548a40cbf]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:20 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD Jul 24 15:51:20 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:20 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:20 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD Jul 24 15:51:20 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Flow 'volume_create_manager' (c4217f07-21f9-4909-b355-01403c96f928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0225904-87fe-43fd-a3d0-52e88104e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0225904-87fe-43fd-a3d0-52e88104e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57137543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b85ad5e-3915-424e-9486-bf29be78ab1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d53792b989d41e58830c8aa68abdd9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:21Z,use_quota=True,user_id='49c5e2439f104f1a991db5952e1fa25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ada48d-5a5c-4b48-9657-2d676572363d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ada48d-5a5c-4b48-9657-2d676572363d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b4e2fd-8e86-4efb-8b12-8bc9a9a0de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b4e2fd-8e86-4efb-8b12-8bc9a9a0de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b85ad5e-3915-424e-9486-bf29be78ab1a', 'volume_name': 'volume-9b85ad5e-3915-424e-9486-bf29be78ab1a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4ecd25-5b46-419c-8a6e-fcc72fa96d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4ecd25-5b46-419c-8a6e-fcc72fa96d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d975b9-79fd-4c72-9c8c-2aa29ccbad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Volume 9b85ad5e-3915-424e-9486-bf29be78ab1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b85ad5e-3915-424e-9486-bf29be78ab1a', 'volume_size': 1} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57137543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b85ad5e-3915-424e-9486-bf29be78ab1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d53792b989d41e58830c8aa68abdd9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:21Z,use_quota=True,user_id='49c5e2439f104f1a991db5952e1fa25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Creating volume 9b85ad5e-3915-424e-9486-bf29be78ab1a {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:20 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:20 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a 1073741824 Jul 24 15:51:20 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:20 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD" returned: 1 in 0.485s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:20 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Temporary image 8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee is fetched for user 07940bc73ea74554a1a31f422723b751. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2218bed-828a-45fc-8960-a230b47e7cf5]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:21 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD Jul 24 15:51:21 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:21 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a 1073741824" returned: 0 in 0.599s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:21 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a Jul 24 15:51:21 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:21 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:21 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD Jul 24 15:51:21 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:21 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a" returned: 0 in 0.376s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d975b9-79fd-4c72-9c8c-2aa29ccbad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b85ad5e-3915-424e-9486-bf29be78ab1a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4929f5be-fef8-49ec-8e78-bcad78cc1102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:21 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b60476-7a3c-4d48-9fc7-c862c50d8f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b1950a1f90439cb10383d6ea64ef70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:19Z,use_quota=True,user_id='07940bc73ea74554a1a31f422723b751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa68e41e-0b37-47af-93ee-72ffdc47041d),volume_type_id=aa68e41e-0b37-47af-93ee-72ffdc47041d)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Creating volume 17b60476-7a3c-4d48-9fc7-c862c50d8f89 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:21 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Volume volume-9b85ad5e-3915-424e-9486-bf29be78ab1a (9b85ad5e-3915-424e-9486-bf29be78ab1a): created successfully Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4929f5be-fef8-49ec-8e78-bcad78cc1102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:21 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 1073741824 Jul 24 15:51:21 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Flow 'volume_create_manager' (c4217f07-21f9-4909-b355-01403c96f928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:21 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5a0f8771-5a7d-49dd-ab2e-fab3a1130af6 tempest-ProjectReaderTests-1645637958 None] Created volume successfully. Jul 24 15:51:22 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 1073741824" returned: 0 in 0.729s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:22 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 Jul 24 15:51:22 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "cinder-9b85ad5e-3915-424e-9486-bf29be78ab1a-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Lock "cinder-9b85ad5e-3915-424e-9486-bf29be78ab1a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:23 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89" returned: 0 in 0.457s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Attempting download of 8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee ((None, [{'url': 'file:///opt/stack/data/glance/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'metadata': {}}])) to volume 17b60476-7a3c-4d48-9fc7-c862c50d8f89. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "cinder-quobyte-9b85ad5e-3915-424e-9486-bf29be78ab1a" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Lock "cinder-quobyte-9b85ad5e-3915-424e-9486-bf29be78ab1a" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93c47c3-be43-4200-9e6e-ef9bb800f48a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0153d0a6-7ab3-409c-aa23-53c4507dcc9d]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_xyjvxwz7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:23 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a Jul 24 15:51:23 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:23 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_xyjvxwz7 Jul 24 15:51:23 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:23 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_xyjvxwz7" returned: 0 in 0.481s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:23 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_xyjvxwz7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a" returned: 0 in 0.555s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:23 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a Jul 24 15:51:23 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:23 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_xyjvxwz7 Jul 24 15:51:23 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:24 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_xyjvxwz7" returned: 1 in 0.416s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_xyjvxwz7' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[46884f8c-8361-42bb-a77c-673d2890b04a]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:24 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9b85ad5e-3915-424e-9486-bf29be78ab1a" returned: 0 in 0.501s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Lock "cinder-quobyte-9b85ad5e-3915-424e-9486-bf29be78ab1a" released by "delete_volume" :: held 1.114s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:24 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD Jul 24 15:51:24 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Created reservations ['5447f173-977d-4443-a452-1cf2a2a81236', '5f17fa4a-729c-4aad-839a-2710c6a61ea2', 'cc6bd66e-c017-437c-8aaf-d52446065a5a', 'e2afa0a9-8826-452a-a8a4-5ea86ed0b0e9'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:24 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:24 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:24 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD" returned: 0 in 0.558s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:24 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.347s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Deleted volume successfully. Jul 24 15:51:24 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD Jul 24 15:51:24 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-79a4965f-94f1-416d-a576-2ae13f243e14 tempest-ProjectReaderTests-1645637958 None] Lock "cinder-9b85ad5e-3915-424e-9486-bf29be78ab1a-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:25 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD" returned: 1 in 0.393s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:25 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] 8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee was raw, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:51:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:25 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 Jul 24 15:51:25 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:26 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89" returned: 0 in 0.841s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee_s_1f7a66devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:51:26 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:26 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 1G Jul 24 15:51:26 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Flow 'volume_create_manager' (2ca3e1f6-57ef-448a-abc1-2ed8e06ff1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0884f6af-d76f-4c06-b199-1627fc0c7252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0884f6af-d76f-4c06-b199-1627fc0c7252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237550175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb5158f-4f4c-4ca0-b403-c61c5118dd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d53792b989d41e58830c8aa68abdd9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:26Z,use_quota=True,user_id='49c5e2439f104f1a991db5952e1fa25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fc725b-8d61-4767-ad8d-dcc428b02373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fc725b-8d61-4767-ad8d-dcc428b02373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52144af1-e76f-4d01-82c1-ee89865dba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52144af1-e76f-4d01-82c1-ee89865dba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb5158f-4f4c-4ca0-b403-c61c5118dd08', 'volume_name': 'volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c80946-7796-4039-abb0-3d37d2ff9fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c80946-7796-4039-abb0-3d37d2ff9fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54099dc-b0cc-4c75-ac81-a9ffc17cf737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Volume 3bb5158f-4f4c-4ca0-b403-c61c5118dd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08', 'volume_size': 1} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237550175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb5158f-4f4c-4ca0-b403-c61c5118dd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d53792b989d41e58830c8aa68abdd9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:26Z,use_quota=True,user_id='49c5e2439f104f1a991db5952e1fa25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Creating volume 3bb5158f-4f4c-4ca0-b403-c61c5118dd08 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:26 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:26 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 1073741824 Jul 24 15:51:26 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:26 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 1G" returned: 0 in 0.486s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Downloaded image 8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee ((None, [{'url': 'file:///opt/stack/data/glance/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'metadata': {}}])) to volume 17b60476-7a3c-4d48-9fc7-c862c50d8f89 successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Temporary image 8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee for user 07940bc73ea74554a1a31f422723b751 is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Marking volume 17b60476-7a3c-4d48-9fc7-c862c50d8f89 as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Copying metadata from image 8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee to 17b60476-7a3c-4d48-9fc7-c862c50d8f89. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Creating volume glance metadata for volume 17b60476-7a3c-4d48-9fc7-c862c50d8f89 backed by image 8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8988ca9d15ac2fd1ee3e59bd816ea9bf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdc799e-2ba9-40ed-ac45-49fbe7e8f0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89', 'volume_size': 1, 'image_id': '8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8988ca9d15ac2fd1ee3e59bd816ea9bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41b1950a1f90439cb10383d6ea64ef70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b92251dea454c42e4620d1a1c0723ca282c0ca72465b2fbbb43b43b75f870530f68d2ce94da35922c078082f3b848e1182bd90db26304a2b00ea88cb7efc032a', 'id': '8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee', 'created_at': datetime.datetime(2026, 7, 24, 13, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ec45a04-6c47-4ed8-afc1-6d4ad0e1e2ee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dc34d0-3e6f-4093-b67b-93fc987b4562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Volume volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 (17b60476-7a3c-4d48-9fc7-c862c50d8f89): created successfully Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dc34d0-3e6f-4093-b67b-93fc987b4562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Flow 'volume_create_manager' (ce7290c3-9d80-428f-9262-5185a84a3676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f469a104-ed49-4fb2-925a-5c468d155aa6 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Created volume successfully. Jul 24 15:51:27 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 1073741824" returned: 0 in 0.703s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:27 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 Jul 24 15:51:27 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:27 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08" returned: 0 in 0.316s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54099dc-b0cc-4c75-ac81-a9ffc17cf737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc25015-b112-4f61-975c-4a39099ba6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:27 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Volume volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 (3bb5158f-4f4c-4ca0-b403-c61c5118dd08): created successfully Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc25015-b112-4f61-975c-4a39099ba6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Flow 'volume_create_manager' (2ca3e1f6-57ef-448a-abc1-2ed8e06ff1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1dc29fc5-b074-424c-abbd-927a99a07ca9 tempest-ProjectReaderTests-1645637958 None] Created volume successfully. Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Acquiring lock "cinder-17b60476-7a3c-4d48-9fc7-c862c50d8f89-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "cinder-17b60476-7a3c-4d48-9fc7-c862c50d8f89-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Acquiring lock "cinder-quobyte-17b60476-7a3c-4d48-9fc7-c862c50d8f89" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "cinder-quobyte-17b60476-7a3c-4d48-9fc7-c862c50d8f89" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9148a8e-34a0-43c0-8f65-8839394d1060]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:28 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 Jul 24 15:51:28 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:28 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "cinder-3bb5158f-4f4c-4ca0-b403-c61c5118dd08-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89" returned: 0 in 0.537s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Lock "cinder-3bb5158f-4f4c-4ca0-b403-c61c5118dd08-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:28 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89 Jul 24 15:51:28 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "cinder-quobyte-3bb5158f-4f4c-4ca0-b403-c61c5118dd08" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Lock "cinder-quobyte-3bb5158f-4f4c-4ca0-b403-c61c5118dd08" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed49782c-f92c-4e9f-9c8b-c496495ccaa9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:28 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 Jul 24 15:51:28 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:28 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-17b60476-7a3c-4d48-9fc7-c862c50d8f89" returned: 0 in 0.404s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "cinder-quobyte-17b60476-7a3c-4d48-9fc7-c862c50d8f89" released by "delete_volume" :: held 1.002s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:28 devstack cinder-volume[88251]: WARNING cinder.quota [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:28 devstack cinder-volume[88251]: WARNING cinder.quota [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:28 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Created reservations ['d4971251-ded5-4c15-a5a0-bcecd7fb0169', '2870a39f-0ec0-442d-bbc4-34e7ad644287', 'fab9b87f-e9fe-4f80-be51-3a392b68c7b6', 'b28b8403-29bf-4bfa-a4f2-025d650d4268'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:29 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:29 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:29 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08" returned: 0 in 0.561s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:29 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08 Jul 24 15:51:29 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:29 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.318s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Deleted volume successfully. Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95012431-ff28-4ee4-87e0-ac5d38bbfd94 tempest-VolumeAndVolumeTypeFromImageTest-1397884441 None] Lock "cinder-17b60476-7a3c-4d48-9fc7-c862c50d8f89-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:29 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3bb5158f-4f4c-4ca0-b403-c61c5118dd08" returned: 0 in 0.309s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Lock "cinder-quobyte-3bb5158f-4f4c-4ca0-b403-c61c5118dd08" released by "delete_volume" :: held 0.923s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Created reservations ['2071364f-4c1d-4999-8311-eb74a858b93a', '4b388ceb-18aa-482a-b0e4-3e18bfb3e91f', 'd22cf675-03d7-4801-bae4-774d951ba254', 'b1323a28-d938-47ae-8dcb-32ad44012961'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:29 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:29 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:29 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.267s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Deleted volume successfully. Jul 24 15:51:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-dcee0293-707f-4eff-a143-9f6df24ae6a1 tempest-ProjectReaderTests-1645637958 None] Lock "cinder-3bb5158f-4f4c-4ca0-b403-c61c5118dd08-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:51:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:34 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:34 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:35 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.309s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:51:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:51:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Flow 'volume_create_manager' (443a4989-bd05-4b42-bbc1-b7987907102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a17ace-57c1-4052-9628-ae106d639358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a17ace-57c1-4052-9628-ae106d639358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-935744149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a15e398-d163-4e9f-9721-e87d1c9f5f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f973857470e44d028ee31fe0a58640d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:38Z,use_quota=True,user_id='932f99597a5e4514bad573432832a5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cc0b8c-9ec5-4b2e-82f5-53367ef1e62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cc0b8c-9ec5-4b2e-82f5-53367ef1e62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3672809c-0f27-441a-a7ac-f01e8e679a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3672809c-0f27-441a-a7ac-f01e8e679a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a15e398-d163-4e9f-9721-e87d1c9f5f27', 'volume_name': 'volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5daa616-c02a-4155-b267-f9783f355b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5daa616-c02a-4155-b267-f9783f355b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b60208-7d3f-42a0-ba2b-bde5ae5c33c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:38 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Volume 7a15e398-d163-4e9f-9721-e87d1c9f5f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27', 'volume_size': 1} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-935744149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a15e398-d163-4e9f-9721-e87d1c9f5f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f973857470e44d028ee31fe0a58640d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:38Z,use_quota=True,user_id='932f99597a5e4514bad573432832a5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Creating volume 7a15e398-d163-4e9f-9721-e87d1c9f5f27 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:38 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:38 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 1073741824 Jul 24 15:51:38 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:38 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 1073741824" returned: 0 in 0.581s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:39 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 Jul 24 15:51:39 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:39 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27" returned: 0 in 0.315s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:39 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b60208-7d3f-42a0-ba2b-bde5ae5c33c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:39 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7671ba09-27fe-4f8e-b9ee-730a8f8491c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:39 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Volume volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 (7a15e398-d163-4e9f-9721-e87d1c9f5f27): created successfully Jul 24 15:51:39 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7671ba09-27fe-4f8e-b9ee-730a8f8491c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:39 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Flow 'volume_create_manager' (443a4989-bd05-4b42-bbc1-b7987907102c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:39 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9fd73fca-774b-49c6-bf42-77148fac69b9 tempest-SnapshotMetadataTestJSON-1289218978 None] Created volume successfully. Jul 24 15:51:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Creating offline snapshot da30519b-aaa9-4b49-b95f-6c6e76c26c41 of volume 7a15e398-d163-4e9f-9721-e87d1c9f5f27 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:51:40 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[266c1f45-2dd8-41e1-8a1b-45d2ba08f6bd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:40 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 Jul 24 15:51:40 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Flow 'volume_create_manager' (a1f6d2ee-1ef9-4c71-bfc3-1d778331a08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eda2ce2-c069-4d48-9dea-ec92c32b0850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eda2ce2-c069-4d48-9dea-ec92c32b0850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148fd7a4-7768-47ed-8042-4870299567c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bc016cd2544b3b9e4c9ac89adb1af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:41Z,use_quota=True,user_id='c5d4fcb1ac8b40c8bb2476edae2380c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf75528b-ea17-4c31-a9f5-b7f9781b20c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf75528b-ea17-4c31-a9f5-b7f9781b20c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db0206a-bbcd-4e36-8e6c-3fdda6d1c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27" returned: 0 in 0.610s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:41 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 1G Jul 24 15:51:41 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db0206a-bbcd-4e36-8e6c-3fdda6d1c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '148fd7a4-7768-47ed-8042-4870299567c9', 'volume_name': 'volume-148fd7a4-7768-47ed-8042-4870299567c9', 'volume_size': 1, 'image_id': '98e09785-fa16-48b1-80d8-bc50be5aba00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98e09785-fa16-48b1-80d8-bc50be5aba00', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c615b3dc4c54cb6b5b228ebcebd83fee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4bc016cd2544b3b9e4c9ac89adb1af5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '41d26d170c242548637fc451382e22fa6f6bbfa93dcaac7b797c785b85c21683d90360e7f05f1dbaf7b8dcc072a9112f3bbc8ab47f9662f5631a6fc261dcbe16', 'id': '98e09785-fa16-48b1-80d8-bc50be5aba00', 'created_at': datetime.datetime(2026, 7, 24, 13, 51, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 51, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e09785-fa16-48b1-80d8-bc50be5aba00/file', 'properties': {}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452f5ccd-7501-452c-a1d5-eb358e61ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452f5ccd-7501-452c-a1d5-eb358e61ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f45e41-1f70-4c66-9d7b-ae6a585a04cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Volume 148fd7a4-7768-47ed-8042-4870299567c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-148fd7a4-7768-47ed-8042-4870299567c9', 'volume_size': 1, 'image_id': '98e09785-fa16-48b1-80d8-bc50be5aba00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98e09785-fa16-48b1-80d8-bc50be5aba00', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c615b3dc4c54cb6b5b228ebcebd83fee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4bc016cd2544b3b9e4c9ac89adb1af5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '41d26d170c242548637fc451382e22fa6f6bbfa93dcaac7b797c785b85c21683d90360e7f05f1dbaf7b8dcc072a9112f3bbc8ab47f9662f5631a6fc261dcbe16', 'id': '98e09785-fa16-48b1-80d8-bc50be5aba00', 'created_at': datetime.datetime(2026, 7, 24, 13, 51, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 51, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e09785-fa16-48b1-80d8-bc50be5aba00/file', 'properties': {}}, 'image_service': } Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Trying to clone 148fd7a4-7768-47ed-8042-4870299567c9 from image 98e09785-fa16-48b1-80d8-bc50be5aba00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/98e09785-fa16-48b1-80d8-bc50be5aba00', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:51:41 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 1G" returned: 0 in 0.550s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:41 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 Jul 24 15:51:41 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (57a900fd-061a-45a3-bc94-00bf909843e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e9c63f-d481-491c-86f0-95b4322e3b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e9c63f-d481-491c-86f0-95b4322e3b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-916479983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b064a1-9bbf-42b1-8033-e0be79ee81cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:42Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d62cf1c-7947-4c10-be5a-ff0585acf2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d62cf1c-7947-4c10-be5a-ff0585acf2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac7eccc-4c9e-4740-b63b-1ab746a3576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac7eccc-4c9e-4740-b63b-1ab746a3576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b064a1-9bbf-42b1-8033-e0be79ee81cf', 'volume_name': 'volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267de8ff-9d4d-4e62-a481-96ccdb82208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267de8ff-9d4d-4e62-a481-96ccdb82208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581ad9a0-9de6-4827-b75c-4942b9159f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Volume a1b064a1-9bbf-42b1-8033-e0be79ee81cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf', 'volume_size': 1} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:51:41 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Image download 0.00 MB at 0.00 MB/s Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[662c406f-fa49-4755-8faa-1a4c11260e2a]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:42 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD Jul 24 15:51:42 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:42 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41" returned: 0 in 0.371s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:42 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 is being set with open permissions: ugo+rw Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:42 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 Jul 24 15:51:42 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:42 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:42 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD Jul 24 15:51:42 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:42 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:42 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.info Jul 24 15:51:42 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:42 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Temporary image 98e09785-fa16-48b1-80d8-bc50be5aba00 is fetched for user c5d4fcb1ac8b40c8bb2476edae2380c7. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[380d05f2-9c5a-4ac2-9108-78b86a7e75f9]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:42 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.info" returned: 0 in 0.315s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:42 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.info is being set with open permissions: ugo+rw Jul 24 15:51:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:42 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.info Jul 24 15:51:42 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:42 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD Jul 24 15:51:42 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.info" returned: 0 in 0.239s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.523s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-916479983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b064a1-9bbf-42b1-8033-e0be79ee81cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:42Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Creating volume a1b064a1-9bbf-42b1-8033-e0be79ee81cf {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:43 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:43 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:43 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf 1073741824 Jul 24 15:51:43 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-429e86c8-672d-4412-963a-533b674401e1 tempest-SnapshotMetadataTestJSON-1289218978 None] Create snapshot completed successfully Jul 24 15:51:43 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD Jul 24 15:51:43 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:43 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf 1073741824" returned: 0 in 0.491s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:43 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf Jul 24 15:51:43 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" returned: 0 in 0.302s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148fd7a4-7768-47ed-8042-4870299567c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bc016cd2544b3b9e4c9ac89adb1af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:41Z,use_quota=True,user_id='c5d4fcb1ac8b40c8bb2476edae2380c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Creating volume 148fd7a4-7768-47ed-8042-4870299567c9 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:43 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581ad9a0-9de6-4827-b75c-4942b9159f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:43 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 1073741824 Jul 24 15:51:43 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d8d6ec-d227-44b7-abad-36a935e58c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:43 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Volume volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf (a1b064a1-9bbf-42b1-8033-e0be79ee81cf): created successfully Jul 24 15:51:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d8d6ec-d227-44b7-abad-36a935e58c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (57a900fd-061a-45a3-bc94-00bf909843e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:44 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-60b24f60-27a4-4d62-b390-40b844a6c4fb tempest-VolumesActionsTest-539102236 None] Created volume successfully. Jul 24 15:51:44 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 1073741824" returned: 0 in 0.498s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "cinder-da30519b-aaa9-4b49-b95f-6c6e76c26c41-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-da30519b-aaa9-4b49-b95f-6c6e76c26c41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "cinder-quobyte-7a15e398-d163-4e9f-9721-e87d1c9f5f27" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:44 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 Jul 24 15:51:44 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-quobyte-7a15e398-d163-4e9f-9721-e87d1c9f5f27" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "cinder-quobyte-da30519b-aaa9-4b49-b95f-6c6e76c26c41" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-quobyte-da30519b-aaa9-4b49-b95f-6c6e76c26c41" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Deleting offline snapshot da30519b-aaa9-4b49-b95f-6c6e76c26c41 of volume 7a15e398-d163-4e9f-9721-e87d1c9f5f27 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] snapshot_file for this snap is: volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cf9ebc-eefe-4004-9032-ec4df1b7577f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:44 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 Jul 24 15:51:44 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:44 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Attempting download of 98e09785-fa16-48b1-80d8-bc50be5aba00 ((None, [{'url': 'file:///opt/stack/data/glance/images/98e09785-fa16-48b1-80d8-bc50be5aba00', 'metadata': {}}])) to volume 148fd7a4-7768-47ed-8042-4870299567c9. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3592354b-1cc5-41ae-a5e3-ad67042c8cab]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98e09785-fa16-48b1-80d8-bc50be5aba00_1vhcymxi {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a8466c30-e5b4-4daa-ae4a-a44218056976 tempest-VolumesActionsTest-539102236 None] Acquiring lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" by "attach_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a8466c30-e5b4-4daa-ae4a-a44218056976 tempest-VolumesActionsTest-539102236 None] Lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" acquired by "attach_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a8466c30-e5b4-4daa-ae4a-a44218056976 tempest-VolumesActionsTest-539102236 None] Attaching volume a1b064a1-9bbf-42b1-8033-e0be79ee81cf to instance 3e9c6407-7505-45ba-ba1a-845ae0b7754e at mountpoint /dev/vdb on host None. Jul 24 15:51:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a8466c30-e5b4-4daa-ae4a-a44218056976 tempest-VolumesActionsTest-539102236 None] Attach volume completed successfully. Jul 24 15:51:45 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98e09785-fa16-48b1-80d8-bc50be5aba00_1vhcymxi Jul 24 15:51:45 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a8466c30-e5b4-4daa-ae4a-a44218056976 tempest-VolumesActionsTest-539102236 None] Lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" released by "attach_volume" :: held 0.122s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:45 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41" returned: 0 in 0.506s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6718751c-85d0-45a6-948d-6eb85ecc67e0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:45 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 Jul 24 15:51:45 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:45 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98e09785-fa16-48b1-80d8-bc50be5aba00_1vhcymxi" returned: 0 in 0.569s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98e09785-fa16-48b1-80d8-bc50be5aba00_1vhcymxi {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:45 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27" returned: 0 in 0.465s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:45 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98e09785-fa16-48b1-80d8-bc50be5aba00_1vhcymxi Jul 24 15:51:45 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:45 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 Jul 24 15:51:45 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-41c37814-d0f0-4683-bed6-1346d745f86c tempest-VolumesActionsTest-1124389375 None] Terminate volume connection completed successfully. Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-41c37814-d0f0-4683-bed6-1346d745f86c tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-detach_volume" by "detach_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:45 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-41c37814-d0f0-4683-bed6-1346d745f86c tempest-VolumesActionsTest-1124389375 None] Lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98e09785-fa16-48b1-80d8-bc50be5aba00_1vhcymxi" returned: 1 in 0.490s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98e09785-fa16-48b1-80d8-bc50be5aba00_1vhcymxi' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb23215-34f3-47c7-9349-5fce828dec8a]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-41c37814-d0f0-4683-bed6-1346d745f86c tempest-VolumesActionsTest-1124389375 None] Detaching volume a1b064a1-9bbf-42b1-8033-e0be79ee81cf from instance 3e9c6407-7505-45ba-ba1a-845ae0b7754e. Jul 24 15:51:46 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41" returned: 0 in 0.432s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-41c37814-d0f0-4683-bed6-1346d745f86c tempest-VolumesActionsTest-1124389375 None] Detach volume completed successfully. Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-41c37814-d0f0-4683-bed6-1346d745f86c tempest-VolumesActionsTest-1124389375 None] Lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:46 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41 Jul 24 15:51:46 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:46 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD Jul 24 15:51:46 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e226b7d-ca39-4da9-aee3-396c3edd8018 tempest-VolumesActionsTest-539102236 None] Acquiring lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-detach_volume" by "detach_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e226b7d-ca39-4da9-aee3-396c3edd8018 tempest-VolumesActionsTest-539102236 None] Lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-4e226b7d-ca39-4da9-aee3-396c3edd8018 tempest-VolumesActionsTest-539102236 None] Volume detach called, but volume not attached. Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e226b7d-ca39-4da9-aee3-396c3edd8018 tempest-VolumesActionsTest-539102236 None] Lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:46 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:46 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27.da30519b-aaa9-4b49-b95f-6c6e76c26c41" returned: 0 in 0.402s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-quobyte-da30519b-aaa9-4b49-b95f-6c6e76c26c41" released by "_delete_snapshot" :: held 1.936s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-quobyte-7a15e398-d163-4e9f-9721-e87d1c9f5f27" released by "delete_snapshot" :: held 1.974s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:46 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD Jul 24 15:51:46 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Created reservations ['b08f81fd-78c1-48c7-b510-5c24215d4c90', 'c9d7d2c8-0e64-4877-89e6-496071f6abe1', 'c89590ae-7960-4c1b-b8c6-cc4eada0d3d8', '6ef1b4d2-0825-410e-9842-76637994a9fd'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Acquiring lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Delete snapshot completed successfully. Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-838087c6-90ca-438c-adcd-c64d0f06d6a9 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-da30519b-aaa9-4b49-b95f-6c6e76c26c41-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Acquiring lock "cinder-quobyte-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Lock "cinder-quobyte-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:46 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] 98e09785-fa16-48b1-80d8-bc50be5aba00 was raw, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6599d6a8-1ae9-4103-8940-10aed9a17848]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:46 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 Jul 24 15:51:46 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:46 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf Jul 24 15:51:46 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:47 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" returned: 0 in 0.399s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:47 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:47 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf Jul 24 15:51:47 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9" returned: 0 in 0.441s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_98e09785-fa16-48b1-80d8-bc50be5aba00_t08l5dl9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:51:47 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:47 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 1G Jul 24 15:51:47 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:47 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Lock "cinder-quobyte-a1b064a1-9bbf-42b1-8033-e0be79ee81cf" released by "delete_volume" :: held 0.735s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=121,cinder:UPDATE=132,cinder:DELETE=12,cinder:INSERT=28 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=122,cinder:INSERT=41,cinder:SELECT=96,cinder:DELETE=9 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Created reservations ['9a31ee7f-4bbf-48d7-a10e-9882d17251bd', '1986f4ae-7399-462d-bfd4-06bd717f630c', '4f4d42e9-2f05-49b9-b510-e64014391adb', '5d966b26-8700-483a-99de-81a4d6247035'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:47 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 1G" returned: 0 in 0.367s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Downloaded image 98e09785-fa16-48b1-80d8-bc50be5aba00 ((None, [{'url': 'file:///opt/stack/data/glance/images/98e09785-fa16-48b1-80d8-bc50be5aba00', 'metadata': {}}])) to volume 148fd7a4-7768-47ed-8042-4870299567c9 successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Temporary image 98e09785-fa16-48b1-80d8-bc50be5aba00 for user c5d4fcb1ac8b40c8bb2476edae2380c7 is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Marking volume 148fd7a4-7768-47ed-8042-4870299567c9 as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Copying metadata from image 98e09785-fa16-48b1-80d8-bc50be5aba00 to 148fd7a4-7768-47ed-8042-4870299567c9. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Creating volume glance metadata for volume 148fd7a4-7768-47ed-8042-4870299567c9 backed by image 98e09785-fa16-48b1-80d8-bc50be5aba00 with: {'image_id': '98e09785-fa16-48b1-80d8-bc50be5aba00', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c615b3dc4c54cb6b5b228ebcebd83fee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:47 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:47 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f45e41-1f70-4c66-9d7b-ae6a585a04cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-148fd7a4-7768-47ed-8042-4870299567c9', 'volume_size': 1, 'image_id': '98e09785-fa16-48b1-80d8-bc50be5aba00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98e09785-fa16-48b1-80d8-bc50be5aba00', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c615b3dc4c54cb6b5b228ebcebd83fee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4bc016cd2544b3b9e4c9ac89adb1af5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '41d26d170c242548637fc451382e22fa6f6bbfa93dcaac7b797c785b85c21683d90360e7f05f1dbaf7b8dcc072a9112f3bbc8ab47f9662f5631a6fc261dcbe16', 'id': '98e09785-fa16-48b1-80d8-bc50be5aba00', 'created_at': datetime.datetime(2026, 7, 24, 13, 51, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 51, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e09785-fa16-48b1-80d8-bc50be5aba00/file', 'properties': {}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b30400-b759-4794-8fcd-3198ef2c7d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:47 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Volume volume-148fd7a4-7768-47ed-8042-4870299567c9 (148fd7a4-7768-47ed-8042-4870299567c9): created successfully Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b30400-b759-4794-8fcd-3198ef2c7d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Flow 'volume_create_manager' (a1f6d2ee-1ef9-4c71-bfc3-1d778331a08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:47 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a1af5028-e114-441f-a78c-91e65ff59a6a tempest-VolumeImageDependencyTests-482766930 None] Created volume successfully. Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "cinder-7a15e398-d163-4e9f-9721-e87d1c9f5f27-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-7a15e398-d163-4e9f-9721-e87d1c9f5f27-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "cinder-quobyte-7a15e398-d163-4e9f-9721-e87d1c9f5f27" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-quobyte-7a15e398-d163-4e9f-9721-e87d1c9f5f27" acquired by "delete_volume" :: waited 0.036s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee9abef-b89f-4ea0-b660-7f87694a083c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:48 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.377s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Deleted volume successfully. Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f64d24a1-07fd-441c-a14f-7b32b5b01533 tempest-VolumesActionsTest-539102236 None] Lock "cinder-a1b064a1-9bbf-42b1-8033-e0be79ee81cf-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:48 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 Jul 24 15:51:48 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:48 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27" returned: 0 in 0.514s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:48 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27 Jul 24 15:51:48 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Acquiring lock "cinder-148fd7a4-7768-47ed-8042-4870299567c9-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Lock "cinder-148fd7a4-7768-47ed-8042-4870299567c9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Acquiring lock "cinder-quobyte-148fd7a4-7768-47ed-8042-4870299567c9" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Lock "cinder-quobyte-148fd7a4-7768-47ed-8042-4870299567c9" acquired by "delete_volume" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df4cb75-ae93-40b9-88cd-7029616f5f4d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:49 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7a15e398-d163-4e9f-9721-e87d1c9f5f27" returned: 0 in 0.485s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-quobyte-7a15e398-d163-4e9f-9721-e87d1c9f5f27" released by "delete_volume" :: held 1.084s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:49 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 Jul 24 15:51:49 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Created reservations ['1af2c7a7-f0b6-4cad-8bea-7eee3e467efe', '5b77b170-c37f-4599-82c1-4795a30264fc', '64ac8445-7c01-41ab-a9a6-2c4ece3f06b9', '57b88a2d-4467-4b8a-8830-211e88674c58'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:49 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:49 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:49 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9" returned: 0 in 0.553s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:49 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9 Jul 24 15:51:49 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:49 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.378s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Deleted volume successfully. Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8ef31dd3-a8d0-4743-a46d-58ae7a261ad6 tempest-SnapshotMetadataTestJSON-1289218978 None] Lock "cinder-7a15e398-d163-4e9f-9721-e87d1c9f5f27-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:49 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-148fd7a4-7768-47ed-8042-4870299567c9" returned: 0 in 0.334s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Lock "cinder-quobyte-148fd7a4-7768-47ed-8042-4870299567c9" released by "delete_volume" :: held 0.978s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:49 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Created reservations ['a2721642-06b3-4179-9676-945782850c6e', 'cad9db81-a20b-4d9f-a994-720e83e08012', '85815867-c2df-4764-86e2-79a7c1050271', '248a65c8-1e63-46d3-9cee-25f67c342b0b'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:50 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:50 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:50 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.289s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Deleted volume successfully. Jul 24 15:51:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7ec1694-246a-43fa-b67c-ceeb2bbd15e8 tempest-VolumeImageDependencyTests-482766930 None] Lock "cinder-148fd7a4-7768-47ed-8042-4870299567c9-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (b458d729-4892-4427-b93d-7110a752f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e84b92-cea8-4a5d-89d8-a93fbf8db580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e84b92-cea8-4a5d-89d8-a93fbf8db580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-128709376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:52Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ce6f30-e533-48c5-a4c7-a51f3b9a0808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ce6f30-e533-48c5-a4c7-a51f3b9a0808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d616692-34a6-4a08-af67-cd032d93f226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d616692-34a6-4a08-af67-cd032d93f226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f', 'volume_name': 'volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0ae5cb-054a-443d-95eb-efe4a06de4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0ae5cb-054a-443d-95eb-efe4a06de4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8a7363-6837-4228-b1d7-388596a9e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Volume fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f', 'volume_size': 1} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-128709376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:52Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Creating volume fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:51 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:51 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f 1073741824 Jul 24 15:51:51 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:52 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f 1073741824" returned: 0 in 0.560s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:52 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f Jul 24 15:51:52 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:52 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f" returned: 0 in 0.318s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8a7363-6837-4228-b1d7-388596a9e445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa30c86c-3805-467e-8479-5aa0971baa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:52 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Volume volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f (fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f): created successfully Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa30c86c-3805-467e-8479-5aa0971baa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (b458d729-4892-4427-b93d-7110a752f779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b0e75db0-bbab-4bf3-924e-ea012a3a8131 tempest-VolumesActionsTest-539102236 None] Created volume successfully. Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Lock "cinder-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Flow 'volume_create_manager' (fee7fe01-aba1-4527-a749-dd48236c2169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0ea5cd-e9f6-4892-b773-886d8045047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-quobyte-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0ea5cd-e9f6-4892-b773-886d8045047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-246686547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f189740b-fa81-4595-8692-9541a88a9479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13927480c1df4e97806e01bd5fdd40f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:54Z,use_quota=True,user_id='bf8e0daf8383424ea3a7543af9bc6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70186c37-64c2-4a93-9fd4-49e664fee747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70186c37-64c2-4a93-9fd4-49e664fee747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0981d22-6e2a-42cc-99d4-66f32788e8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0981d22-6e2a-42cc-99d4-66f32788e8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f189740b-fa81-4595-8692-9541a88a9479', 'volume_name': 'volume-f189740b-fa81-4595-8692-9541a88a9479', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3670712-0da1-426f-a630-2e15e2a598a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3670712-0da1-426f-a630-2e15e2a598a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96209954-73dc-445a-9b3d-82adffad12d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:54 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Volume f189740b-fa81-4595-8692-9541a88a9479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f189740b-fa81-4595-8692-9541a88a9479', 'volume_size': 1} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-246686547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f189740b-fa81-4595-8692-9541a88a9479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13927480c1df4e97806e01bd5fdd40f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:54Z,use_quota=True,user_id='bf8e0daf8383424ea3a7543af9bc6bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Creating volume f189740b-fa81-4595-8692-9541a88a9479 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:54 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Lock "cinder-quobyte-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f" acquired by "delete_volume" :: waited 0.087s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:54 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 1073741824 Jul 24 15:51:54 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e477224-3e7a-4e79-9d62-474f4623978d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:54 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f Jul 24 15:51:54 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:54 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f" returned: 0 in 0.403s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:54 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:54 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f Jul 24 15:51:54 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 1073741824" returned: 0 in 0.506s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:54 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 Jul 24 15:51:54 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Flow 'volume_create_manager' (ae587cdb-7175-4562-928f-9097e0f0446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11434fd4-9532-46c1-9b0c-17207585a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:54 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Lock "cinder-quobyte-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f" released by "delete_volume" :: held 0.761s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11434fd4-9532-46c1-9b0c-17207585a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760cb244-eb57-4868-8e4e-417822985d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7290bad04e3a43f592122a3dabd55376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:55Z,use_quota=True,user_id='7889f0941bad4e19bc7a20e14490bae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc90736-ffe6-4468-9b70-fe337aa5bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc90736-ffe6-4468-9b70-fe337aa5bb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398df1bf-8f30-4067-b038-733bb21c3d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398df1bf-8f30-4067-b038-733bb21c3d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760cb244-eb57-4868-8e4e-417822985d24', 'volume_name': 'volume-760cb244-eb57-4868-8e4e-417822985d24', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab210c14-7415-446e-9990-64744b2548e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab210c14-7415-446e-9990-64744b2548e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6300a11b-9d6c-4918-b7cd-939b252d019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:55 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Volume 760cb244-eb57-4868-8e4e-417822985d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760cb244-eb57-4868-8e4e-417822985d24', 'volume_size': 1} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:55 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479" returned: 0 in 0.283s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760cb244-eb57-4868-8e4e-417822985d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7290bad04e3a43f592122a3dabd55376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:55Z,use_quota=True,user_id='7889f0941bad4e19bc7a20e14490bae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Creating volume 760cb244-eb57-4868-8e4e-417822985d24 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:55 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96209954-73dc-445a-9b3d-82adffad12d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f189740b-fa81-4595-8692-9541a88a9479', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:55 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 1073741824 Jul 24 15:51:55 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f5b08-f6cc-4402-8ca0-e7cca958cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:55 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Volume volume-f189740b-fa81-4595-8692-9541a88a9479 (f189740b-fa81-4595-8692-9541a88a9479): created successfully Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f5b08-f6cc-4402-8ca0-e7cca958cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Flow 'volume_create_manager' (fee7fe01-aba1-4527-a749-dd48236c2169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b7cffde5-4187-4e6a-859a-bc2aeedc729f tempest-VolumesMetadataTest-1113515799 None] Created volume successfully. Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Created reservations ['0cb9438a-b4cf-4260-a0c8-cba5df6c96f4', '7522b4e4-97f0-4b3c-8ca1-b757c6cd3be9', 'f98af34b-0772-4517-8287-4fd53abc3581', '1cc63364-569f-4497-bae5-4b705e9fd30c'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:55 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:55 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:55 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Deleted volume successfully. Jul 24 15:51:55 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 1073741824" returned: 0 in 0.449s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-429750e2-724d-45d0-9d41-e0a7595f03ed tempest-VolumesActionsTest-1124389375 None] Lock "cinder-fe8ecbdc-1c3b-4dbd-ace2-3cb32d0cda1f-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:55 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 Jul 24 15:51:55 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:55 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24" returned: 0 in 0.249s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6300a11b-9d6c-4918-b7cd-939b252d019f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760cb244-eb57-4868-8e4e-417822985d24', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2a40a4-a5bb-40fe-8fa4-ab338699d388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:55 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Volume volume-760cb244-eb57-4868-8e4e-417822985d24 (760cb244-eb57-4868-8e4e-417822985d24): created successfully Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2a40a4-a5bb-40fe-8fa4-ab338699d388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Flow 'volume_create_manager' (ae587cdb-7175-4562-928f-9097e0f0446e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c9f8715e-dff0-4ba4-a524-dcb59a132267 tempest-CinderUnicodeTest-806848988 None] Created volume successfully. Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (e8a76e5b-1150-4df7-8d3d-ac90f11638d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bc3194-5e6e-48c3-86bb-1cb29bcead65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bc3194-5e6e-48c3-86bb-1cb29bcead65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1003930868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f4e390-6540-423e-9b98-7e05a1a27f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:57Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5eae58-e102-41bb-9a0f-1023704601b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5eae58-e102-41bb-9a0f-1023704601b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b7f5b3-bc51-41ad-ac8d-f2ceea8a683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b7f5b3-bc51-41ad-ac8d-f2ceea8a683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f4e390-6540-423e-9b98-7e05a1a27f1a', 'volume_name': 'volume-25f4e390-6540-423e-9b98-7e05a1a27f1a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23951c0-a3d2-45bd-8619-6932963aed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23951c0-a3d2-45bd-8619-6932963aed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b236cc34-a442-4cac-ab89-cf399b463510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:56 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Volume 25f4e390-6540-423e-9b98-7e05a1a27f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f4e390-6540-423e-9b98-7e05a1a27f1a', 'volume_size': 1} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1003930868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f4e390-6540-423e-9b98-7e05a1a27f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:57Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Creating volume 25f4e390-6540-423e-9b98-7e05a1a27f1a {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:56 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Acquiring lock "cinder-f189740b-fa81-4595-8692-9541a88a9479-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Lock "cinder-f189740b-fa81-4595-8692-9541a88a9479-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:56 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a 1073741824 Jul 24 15:51:56 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Acquiring lock "cinder-quobyte-f189740b-fa81-4595-8692-9541a88a9479" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Lock "cinder-quobyte-f189740b-fa81-4595-8692-9541a88a9479" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15688fe-fe0e-4023-8b47-00bd59d11054]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:57 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 Jul 24 15:51:57 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:57 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a 1073741824" returned: 0 in 0.514s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:57 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479" returned: 0 in 0.439s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:57 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a Jul 24 15:51:57 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:57 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479 Jul 24 15:51:57 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Flow 'volume_create_manager' (3f7ed375-d1e0-4308-9e97-012a096f3241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09523691-0fd8-4d3d-9b07-211bb8bc4e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09523691-0fd8-4d3d-9b07-211bb8bc4e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-25268687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b3909e-1e3c-4e80-91c5-a414b2833f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7290bad04e3a43f592122a3dabd55376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:58Z,use_quota=True,user_id='7889f0941bad4e19bc7a20e14490bae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86c1ec0-8a7d-441a-a890-cd3c26e46a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86c1ec0-8a7d-441a-a890-cd3c26e46a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a9426a-c642-446d-992f-558deee2e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a9426a-c642-446d-992f-558deee2e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b3909e-1e3c-4e80-91c5-a414b2833f0c', 'volume_name': 'volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1303cf18-bcd9-4628-a343-491c5524cfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1303cf18-bcd9-4628-a343-491c5524cfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98712cd3-76db-4e72-824d-63114a1a6062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:57 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Volume 51b3909e-1e3c-4e80-91c5-a414b2833f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c', 'volume_size': 1} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:57 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a" returned: 0 in 0.289s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-25268687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b3909e-1e3c-4e80-91c5-a414b2833f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7290bad04e3a43f592122a3dabd55376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:58Z,use_quota=True,user_id='7889f0941bad4e19bc7a20e14490bae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Creating volume 51b3909e-1e3c-4e80-91c5-a414b2833f0c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:57 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:57 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-f189740b-fa81-4595-8692-9541a88a9479" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:57 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c 1073741824 Jul 24 15:51:57 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b236cc34-a442-4cac-ab89-cf399b463510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f4e390-6540-423e-9b98-7e05a1a27f1a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e23e87-3106-41b7-abba-6cbaad624ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Lock "cinder-quobyte-f189740b-fa81-4595-8692-9541a88a9479" released by "delete_volume" :: held 0.817s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:57 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Volume volume-25f4e390-6540-423e-9b98-7e05a1a27f1a (25f4e390-6540-423e-9b98-7e05a1a27f1a): created successfully Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e23e87-3106-41b7-abba-6cbaad624ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (e8a76e5b-1150-4df7-8d3d-ac90f11638d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:57 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-da7f3820-96e6-4663-9fa8-18f6a81e895d tempest-VolumesActionsTest-539102236 None] Created volume successfully. Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Created reservations ['ea765e48-fd43-4baf-848a-b19ffcaebe97', '90148329-7c73-42ef-9911-5189a89ccce9', '20ff753e-01b2-4538-b99a-a98aa7b7d29d', '9ed8774e-5cd1-4e59-b162-410009fb11ca'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:57 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:51:57 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:58 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.302s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Deleted volume successfully. Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d73e33ba-ab2d-45e1-9e21-5c578d3f05c9 tempest-VolumesMetadataTest-1113515799 None] Lock "cinder-f189740b-fa81-4595-8692-9541a88a9479-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:58 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c 1073741824" returned: 0 in 0.568s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:58 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c Jul 24 15:51:58 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:58 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98712cd3-76db-4e72-824d-63114a1a6062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c97299-a8ee-49ab-91fd-879cd410bae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:58 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Volume volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c (51b3909e-1e3c-4e80-91c5-a414b2833f0c): created successfully Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c97299-a8ee-49ab-91fd-879cd410bae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:58 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Flow 'volume_create_manager' (3f7ed375-d1e0-4308-9e97-012a096f3241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d73cb87e-9162-48fc-93df-c88bc312b220 tempest-CinderUnicodeTest-806848988 None] Created volume successfully. Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-25f4e390-6540-423e-9b98-7e05a1a27f1a-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Lock "cinder-25f4e390-6540-423e-9b98-7e05a1a27f1a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-quobyte-25f4e390-6540-423e-9b98-7e05a1a27f1a" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Lock "cinder-quobyte-25f4e390-6540-423e-9b98-7e05a1a27f1a" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a7de1e-da64-49d2-a534-c5811d824349]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:59 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a Jul 24 15:51:59 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:59 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a" returned: 0 in 0.461s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:59 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a Jul 24 15:51:59 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:59 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-25f4e390-6540-423e-9b98-7e05a1a27f1a" returned: 0 in 0.320s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Lock "cinder-quobyte-25f4e390-6540-423e-9b98-7e05a1a27f1a" released by "delete_volume" :: held 0.825s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Creating offline snapshot a49b1e70-833a-4e5a-a69c-8b2054be1711 of volume 51b3909e-1e3c-4e80-91c5-a414b2833f0c {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83e30ac-090d-49a0-9ac3-0525bb796e87]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Created reservations ['106d95e7-7e2a-403c-bde5-e02bd9835df5', '04f5d4d7-92c9-4064-8efc-fb2de78aafc2', '360f5163-2521-4933-ade5-9cd9fc0e91c4', '12b2e0fb-4d16-4453-b9f6-f9c05c12d5d6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:00 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c Jul 24 15:52:00 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:00 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:00 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:00 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c" returned: 0 in 0.467s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:00 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 1G Jul 24 15:52:00 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:00 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.391s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Deleted volume successfully. Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6b2e8c54-480f-4000-b828-aa7b22a20fa8 tempest-VolumesActionsTest-1124389375 None] Lock "cinder-25f4e390-6540-423e-9b98-7e05a1a27f1a-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (450c4fe2-faa5-4b1d-abcd-7d33dd3af4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7f52be-055f-456c-bb11-d51d75353ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7f52be-055f-456c-bb11-d51d75353ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-655720900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:01Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fd170d-2121-44c7-9c46-a8be0c2fb5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fd170d-2121-44c7-9c46-a8be0c2fb5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ae9cf0-557b-4943-a55b-a11c54b10880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ae9cf0-557b-4943-a55b-a11c54b10880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c', 'volume_name': 'volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb84dc89-5aae-4b4f-b7c4-65c2ac2cddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb84dc89-5aae-4b4f-b7c4-65c2ac2cddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:01 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbb3ba9-c96b-4b52-967b-2a0f716b9ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:01 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Volume 22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c', 'volume_size': 1} Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 1G" returned: 0 in 0.542s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:01 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 Jul 24 15:52:01 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:01 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711" returned: 0 in 0.302s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:01 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 is being set with open permissions: ugo+rw Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:01 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 Jul 24 15:52:01 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:01 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:01 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.info Jul 24 15:52:01 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:01 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.info" returned: 0 in 0.278s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:01 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.info is being set with open permissions: ugo+rw Jul 24 15:52:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:01 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.info Jul 24 15:52:01 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:02 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.info" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.208s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-655720900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:01Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Creating volume 22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:02 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:02 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c 1073741824 Jul 24 15:52:02 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:02 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f35e9104-ac6a-48ad-bbcc-b465638b7968 tempest-CinderUnicodeTest-806848988 None] Create snapshot completed successfully Jul 24 15:52:02 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c 1073741824" returned: 0 in 0.521s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:02 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c Jul 24 15:52:02 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:03 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c" returned: 0 in 0.282s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbb3ba9-c96b-4b52-967b-2a0f716b9ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9db9d2e-d100-4f3f-bf1c-cf15e280f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:03 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Volume volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c (22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c): created successfully Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9db9d2e-d100-4f3f-bf1c-cf15e280f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (450c4fe2-faa5-4b1d-abcd-7d33dd3af4cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Acquiring lock "cinder-a49b1e70-833a-4e5a-a69c-8b2054be1711-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:03 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ccec0f5a-29cf-448e-b23e-9db434810fac tempest-VolumesActionsTest-539102236 None] Created volume successfully. Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Lock "cinder-a49b1e70-833a-4e5a-a69c-8b2054be1711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Acquiring lock "cinder-quobyte-51b3909e-1e3c-4e80-91c5-a414b2833f0c" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Lock "cinder-quobyte-51b3909e-1e3c-4e80-91c5-a414b2833f0c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Acquiring lock "cinder-quobyte-a49b1e70-833a-4e5a-a69c-8b2054be1711" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Lock "cinder-quobyte-a49b1e70-833a-4e5a-a69c-8b2054be1711" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Deleting offline snapshot a49b1e70-833a-4e5a-a69c-8b2054be1711 of volume 51b3909e-1e3c-4e80-91c5-a414b2833f0c {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] snapshot_file for this snap is: volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[043e3817-2540-4663-9be5-5fd6da3da52b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:03 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 Jul 24 15:52:03 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:03 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711" returned: 0 in 0.380s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed90f57-5da8-4f68-8265-b3264d15939f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:03 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c Jul 24 15:52:03 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:04 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c" returned: 0 in 0.405s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:04 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 Jul 24 15:52:04 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Lock "cinder-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-quobyte-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Lock "cinder-quobyte-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd16a4d4-1967-4108-94fe-8d786cd395c7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:04 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c Jul 24 15:52:04 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:04 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711" returned: 0 in 0.420s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:04 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711 Jul 24 15:52:04 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:04 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c" returned: 0 in 0.392s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:04 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c Jul 24 15:52:04 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:04 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c.a49b1e70-833a-4e5a-a69c-8b2054be1711" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Lock "cinder-quobyte-a49b1e70-833a-4e5a-a69c-8b2054be1711" released by "_delete_snapshot" :: held 1.631s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Lock "cinder-quobyte-51b3909e-1e3c-4e80-91c5-a414b2833f0c" released by "delete_snapshot" :: held 1.655s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:04 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Created reservations ['0cc84836-c07a-4a7b-8a36-e8dfa8254091', '6cb07ed7-5a0a-454f-9373-8aafd89e6295', '76e7bc22-e6d7-4c5a-93df-94cdb7dcd0c5', '5921b140-f238-4767-b14e-bad09f0505ea'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Delete snapshot completed successfully. Jul 24 15:52:05 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87b550a1-f634-4c77-872d-2bf28dc25aec tempest-CinderUnicodeTest-806848988 None] Lock "cinder-a49b1e70-833a-4e5a-a69c-8b2054be1711-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c" returned: 0 in 0.301s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Lock "cinder-quobyte-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c" released by "delete_volume" :: held 0.745s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Created reservations ['2779774e-9de9-4ee6-8bd2-db81e67c2026', '4b8ed980-75a7-4645-8b4e-e5d8df50cb5d', '6505c97a-2ba0-46e9-b384-2e00e8789668', '8f873784-49d6-476c-9d04-6eed92741c38'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:05 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:05 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Acquiring lock "cinder-51b3909e-1e3c-4e80-91c5-a414b2833f0c-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Lock "cinder-51b3909e-1e3c-4e80-91c5-a414b2833f0c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Acquiring lock "cinder-quobyte-51b3909e-1e3c-4e80-91c5-a414b2833f0c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Lock "cinder-quobyte-51b3909e-1e3c-4e80-91c5-a414b2833f0c" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8937f5a-8a9a-4b20-9c1e-2a3c22db5840]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:05 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.367s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Deleted volume successfully. Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6d9944c9-3d25-47c7-b157-dd76f0c7ac27 tempest-VolumesActionsTest-1124389375 None] Lock "cinder-22b57ca3-bc65-4ec0-9d0e-b654f3fbeb4c-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:05 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c Jul 24 15:52:05 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:05 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c" returned: 0 in 0.454s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:06 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c Jul 24 15:52:06 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (86672c48-0805-4dce-900b-cebb35e5eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589410e5-1c57-4f5a-ae55-23f5d357965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589410e5-1c57-4f5a-ae55-23f5d357965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-405318156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee5b858-052b-41eb-ae7d-328eab5d15a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:06Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9881957f-6ffe-4137-9d12-151df664c622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9881957f-6ffe-4137-9d12-151df664c622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6435d15-e8ec-4737-828c-23f01cb056a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6435d15-e8ec-4737-828c-23f01cb056a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee5b858-052b-41eb-ae7d-328eab5d15a4', 'volume_name': 'volume-aee5b858-052b-41eb-ae7d-328eab5d15a4', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15dc0e8-18e3-4c87-956f-681a762057e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15dc0e8-18e3-4c87-956f-681a762057e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c21928b-2fd3-41b7-965e-2b3234832e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:06 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Volume aee5b858-052b-41eb-ae7d-328eab5d15a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee5b858-052b-41eb-ae7d-328eab5d15a4', 'volume_size': 1} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-405318156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee5b858-052b-41eb-ae7d-328eab5d15a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:06Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Creating volume aee5b858-052b-41eb-ae7d-328eab5d15a4 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:06 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:06 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 1073741824 Jul 24 15:52:06 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:06 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51b3909e-1e3c-4e80-91c5-a414b2833f0c" returned: 0 in 0.389s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Lock "cinder-quobyte-51b3909e-1e3c-4e80-91c5-a414b2833f0c" released by "delete_volume" :: held 0.944s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Created reservations ['956f1eff-37c7-4af6-abdf-be4cc250fce3', '69ed9772-29f4-4e44-9504-d2142f94fc7e', '440c8bb7-1915-44a4-9f64-886621d174f4', '5390cd5f-707c-4a59-b7a0-c2dd26b62d3a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:06 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:06 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:06 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 1073741824" returned: 0 in 0.643s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:06 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 Jul 24 15:52:06 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:06 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Deleted volume successfully. Jul 24 15:52:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-13c1fa41-5e8c-46f2-b0a9-8316744e70ff tempest-CinderUnicodeTest-806848988 None] Lock "cinder-51b3909e-1e3c-4e80-91c5-a414b2833f0c-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:07 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4" returned: 0 in 0.338s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c21928b-2fd3-41b7-965e-2b3234832e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee5b858-052b-41eb-ae7d-328eab5d15a4', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed5029e-e8bc-4010-a44b-2c812f049b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:07 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Volume volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 (aee5b858-052b-41eb-ae7d-328eab5d15a4): created successfully Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed5029e-e8bc-4010-a44b-2c812f049b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (86672c48-0805-4dce-900b-cebb35e5eb92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:07 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-132cd279-5e79-4ad0-b3ff-029e3adaf047 tempest-VolumesActionsTest-539102236 None] Created volume successfully. Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Acquiring lock "cinder-760cb244-eb57-4868-8e4e-417822985d24-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Lock "cinder-760cb244-eb57-4868-8e4e-417822985d24-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Acquiring lock "cinder-quobyte-760cb244-eb57-4868-8e4e-417822985d24" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Lock "cinder-quobyte-760cb244-eb57-4868-8e4e-417822985d24" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[03afa10b-b734-4a0b-9903-1fa53dbffed2]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:07 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 Jul 24 15:52:07 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:08 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24" returned: 0 in 0.431s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:08 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24 Jul 24 15:52:08 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-aee5b858-052b-41eb-ae7d-328eab5d15a4-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Lock "cinder-aee5b858-052b-41eb-ae7d-328eab5d15a4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:08 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Acquiring lock "cinder-quobyte-aee5b858-052b-41eb-ae7d-328eab5d15a4" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-760cb244-eb57-4868-8e4e-417822985d24" returned: 0 in 0.368s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Lock "cinder-quobyte-760cb244-eb57-4868-8e4e-417822985d24" released by "delete_volume" :: held 0.862s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Lock "cinder-quobyte-aee5b858-052b-41eb-ae7d-328eab5d15a4" acquired by "delete_volume" :: waited 0.047s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5614e53-c113-4354-9699-13e1c9dd76fa]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Created reservations ['89fd3674-2260-4afe-bd59-7b3d98252f43', 'db4f888d-a965-482d-81a4-536503754974', '68b28fdb-34c0-4cef-9a90-90ecad1ca29e', '6b7727ff-ebef-4758-9739-925669f0abf5'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:08 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 Jul 24 15:52:08 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:08 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:08 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:09 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4" returned: 0 in 0.517s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:09 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:09 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4 Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:09 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Deleted volume successfully. Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ca3c4077-a379-4c56-8333-a6ab4594d9a6 tempest-CinderUnicodeTest-806848988 None] Lock "cinder-760cb244-eb57-4868-8e4e-417822985d24-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:09 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-aee5b858-052b-41eb-ae7d-328eab5d15a4" returned: 0 in 0.279s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Lock "cinder-quobyte-aee5b858-052b-41eb-ae7d-328eab5d15a4" released by "delete_volume" :: held 0.846s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Created reservations ['8ed17a4c-9aaa-48dc-9e76-e2af8b399f4e', '4bcd86e8-3ae5-4861-a6ff-6c73da6a751c', '59f8ee80-4cd5-4ae1-935c-3c47eda5995f', 'f38cb9b3-7434-4315-8fda-b0bdeef36618'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:09 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:09 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:09 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.251s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Deleted volume successfully. Jul 24 15:52:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e212fa8a-5a38-4b95-b0d0-cb515eec572c tempest-VolumesActionsTest-1124389375 None] Lock "cinder-aee5b858-052b-41eb-ae7d-328eab5d15a4-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (3f3005be-462f-4313-b7ba-603d26c07791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48717ffe-2b58-4b4f-9ae8-9deb0912829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48717ffe-2b58-4b4f-9ae8-9deb0912829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1767073562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa4cf16-ffa9-4b04-a12e-a71fc6810474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:11Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68b37b6-5d9c-4c17-871b-0c72974ba7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68b37b6-5d9c-4c17-871b-0c72974ba7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7008f71-6735-4a09-8f37-a774b22bf96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7008f71-6735-4a09-8f37-a774b22bf96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa4cf16-ffa9-4b04-a12e-a71fc6810474', 'volume_name': 'volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdec45a-3a14-4752-b82e-96a04d0aa226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdec45a-3a14-4752-b82e-96a04d0aa226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5edd7f-6e17-4fe0-89c7-67013ba14a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:11 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Volume 4aa4cf16-ffa9-4b04-a12e-a71fc6810474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474', 'volume_size': 1} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1767073562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa4cf16-ffa9-4b04-a12e-a71fc6810474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8d7cad4b54793bfe127cad9efb0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:11Z,use_quota=True,user_id='c373b4a275c74d839a62f7b58de1d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Creating volume 4aa4cf16-ffa9-4b04-a12e-a71fc6810474 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:11 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:11 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 1073741824 Jul 24 15:52:11 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:11 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 1073741824" returned: 0 in 0.505s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:12 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 Jul 24 15:52:12 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:12 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474" returned: 0 in 0.268s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5edd7f-6e17-4fe0-89c7-67013ba14a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740d4b64-0251-46f1-8558-8e278054b433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:12 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Volume volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 (4aa4cf16-ffa9-4b04-a12e-a71fc6810474): created successfully Jul 24 15:52:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740d4b64-0251-46f1-8558-8e278054b433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Flow 'volume_create_manager' (3f3005be-462f-4313-b7ba-603d26c07791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3e48c72b-140c-4bbc-896e-a713dfc7d1a5 tempest-VolumesActionsTest-539102236 None] Created volume successfully. Jul 24 15:52:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Acquiring lock "cinder-4aa4cf16-ffa9-4b04-a12e-a71fc6810474-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Lock "cinder-4aa4cf16-ffa9-4b04-a12e-a71fc6810474-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Acquiring lock "cinder-quobyte-4aa4cf16-ffa9-4b04-a12e-a71fc6810474" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Lock "cinder-quobyte-4aa4cf16-ffa9-4b04-a12e-a71fc6810474" acquired by "delete_volume" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc64b081-9502-4add-9364-b89b8ccadf0c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:14 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 Jul 24 15:52:14 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:14 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474" returned: 0 in 0.404s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:14 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474 Jul 24 15:52:14 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:14 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-4aa4cf16-ffa9-4b04-a12e-a71fc6810474" returned: 0 in 0.267s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Lock "cinder-quobyte-4aa4cf16-ffa9-4b04-a12e-a71fc6810474" released by "delete_volume" :: held 0.717s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Created reservations ['5d85aa4c-bfff-4124-9132-dd4bccd89f00', '717027b8-0da4-442a-ae00-3e4745153b71', 'dcf491b0-6ea7-458b-9f14-0f2ae7d65a17', 'cc20ff65-a29c-4e8a-a39c-5f2b7ec25500'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:14 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:14 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:15 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.266s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:15 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Deleted volume successfully. Jul 24 15:52:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-857877e3-d91b-41d0-86ed-3148c41f60be tempest-VolumesActionsTest-539102236 None] Lock "cinder-4aa4cf16-ffa9-4b04-a12e-a71fc6810474-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:24 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=80,cinder:INSERT=32,cinder:UPDATE=133,cinder:DELETE=11 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:52:25 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:INSERT=33,cinder:UPDATE=108,cinder:SELECT=85,cinder:DELETE=10 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Flow 'volume_create_manager' (1a6dad6c-16b8-452f-94ba-811b8f1d64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6e8474-fa50-46ab-b786-c3161e1d5745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6e8474-fa50-46ab-b786-c3161e1d5745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1725125817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a36fd1-8824-42c4-87e8-473aec9c9d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321e0e80cb9e4701939280f02747b859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:28Z,use_quota=True,user_id='1d05a48464914692bfac643c602f3ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6e4430-4da4-414e-98bd-e379bca7e7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6e4430-4da4-414e-98bd-e379bca7e7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9996318-58ce-4cfe-8a57-47888342d5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9996318-58ce-4cfe-8a57-47888342d5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a36fd1-8824-42c4-87e8-473aec9c9d18', 'volume_name': 'volume-21a36fd1-8824-42c4-87e8-473aec9c9d18', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c210065a-60f6-4797-96e9-5adbd2002c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c210065a-60f6-4797-96e9-5adbd2002c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed972095-31cc-4d85-89a5-7f5f58cab749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:28 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Volume 21a36fd1-8824-42c4-87e8-473aec9c9d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a36fd1-8824-42c4-87e8-473aec9c9d18', 'volume_size': 1} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1725125817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a36fd1-8824-42c4-87e8-473aec9c9d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321e0e80cb9e4701939280f02747b859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:28Z,use_quota=True,user_id='1d05a48464914692bfac643c602f3ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Creating volume 21a36fd1-8824-42c4-87e8-473aec9c9d18 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:28 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:28 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 1073741824 Jul 24 15:52:28 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:28 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 1073741824" returned: 0 in 0.466s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:28 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 Jul 24 15:52:28 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:29 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18" returned: 0 in 0.271s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed972095-31cc-4d85-89a5-7f5f58cab749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a36fd1-8824-42c4-87e8-473aec9c9d18', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bd8aff-c92d-4d1f-9960-3180ab4504aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:29 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Volume volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 (21a36fd1-8824-42c4-87e8-473aec9c9d18): created successfully Jul 24 15:52:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bd8aff-c92d-4d1f-9960-3180ab4504aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Flow 'volume_create_manager' (1a6dad6c-16b8-452f-94ba-811b8f1d64a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a25b53c7-c0c7-48be-b210-d63ff33c57c7 tempest-VolumesListAdminTestJSON-1106724458 None] Created volume successfully. Jul 24 15:52:30 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Flow 'volume_create_manager' (e2cfba23-826c-4b01-a842-5a4ce3b9935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6362f702-33f2-46be-adaf-596336f96b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6362f702-33f2-46be-adaf-596336f96b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-566992448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841e5747-93c1-4228-9fe7-4917bfd5dd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321e0e80cb9e4701939280f02747b859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:31Z,use_quota=True,user_id='1d05a48464914692bfac643c602f3ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152f316d-1868-45f2-906b-a3adab57d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152f316d-1868-45f2-906b-a3adab57d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd960d0-185b-449b-962b-8b8f30644e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd960d0-185b-449b-962b-8b8f30644e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841e5747-93c1-4228-9fe7-4917bfd5dd6c', 'volume_name': 'volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189e81c8-825f-413f-a623-dd86642d484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189e81c8-825f-413f-a623-dd86642d484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844c5aac-d232-4e45-a86d-6f43c978581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:31 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Volume 841e5747-93c1-4228-9fe7-4917bfd5dd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c', 'volume_size': 1} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-566992448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841e5747-93c1-4228-9fe7-4917bfd5dd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321e0e80cb9e4701939280f02747b859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:31Z,use_quota=True,user_id='1d05a48464914692bfac643c602f3ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Creating volume 841e5747-93c1-4228-9fe7-4917bfd5dd6c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:31 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:31 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c 1073741824 Jul 24 15:52:31 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:31 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c 1073741824" returned: 0 in 0.517s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:31 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c Jul 24 15:52:31 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:31 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c" returned: 0 in 0.325s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844c5aac-d232-4e45-a86d-6f43c978581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6120f4-2ee9-44bf-b199-7c419c0e2ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:32 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Volume volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c (841e5747-93c1-4228-9fe7-4917bfd5dd6c): created successfully Jul 24 15:52:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6120f4-2ee9-44bf-b199-7c419c0e2ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:32 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Flow 'volume_create_manager' (e2cfba23-826c-4b01-a842-5a4ce3b9935d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2c6b7408-b5fb-4711-83ee-444b45237335 tempest-VolumesListAdminTestJSON-1106724458 None] Created volume successfully. Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Flow 'volume_create_manager' (2a704e9b-06c0-4302-9967-b286069fa537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c293a3bf-e857-4bbb-80e9-a8c24ffbd498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c293a3bf-e857-4bbb-80e9-a8c24ffbd498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1492399889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c034a461-1ba3-4f9f-8fad-b947419d27dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321e0e80cb9e4701939280f02747b859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:34Z,use_quota=True,user_id='1d05a48464914692bfac643c602f3ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcace898-8960-4ecc-8207-b12e533bba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcace898-8960-4ecc-8207-b12e533bba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d99977f-66f3-49d0-9c64-540f141b8c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d99977f-66f3-49d0-9c64-540f141b8c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c034a461-1ba3-4f9f-8fad-b947419d27dc', 'volume_name': 'volume-c034a461-1ba3-4f9f-8fad-b947419d27dc', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff7e513-992e-4b62-8404-53f6450a8f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff7e513-992e-4b62-8404-53f6450a8f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5fa3ef-29e4-4689-9da8-5b83b4372b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:33 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Volume c034a461-1ba3-4f9f-8fad-b947419d27dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c034a461-1ba3-4f9f-8fad-b947419d27dc', 'volume_size': 1} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1492399889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c034a461-1ba3-4f9f-8fad-b947419d27dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321e0e80cb9e4701939280f02747b859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:34Z,use_quota=True,user_id='1d05a48464914692bfac643c602f3ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Creating volume c034a461-1ba3-4f9f-8fad-b947419d27dc {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:33 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:33 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc 1073741824 Jul 24 15:52:33 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:34 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc 1073741824" returned: 0 in 0.436s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:34 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc Jul 24 15:52:34 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:34 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc" returned: 0 in 0.306s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5fa3ef-29e4-4689-9da8-5b83b4372b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c034a461-1ba3-4f9f-8fad-b947419d27dc', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d666b83c-7327-4733-9bf1-bd2fdea2bb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:34 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Volume volume-c034a461-1ba3-4f9f-8fad-b947419d27dc (c034a461-1ba3-4f9f-8fad-b947419d27dc): created successfully Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d666b83c-7327-4733-9bf1-bd2fdea2bb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Flow 'volume_create_manager' (2a704e9b-06c0-4302-9967-b286069fa537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:34 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c1f656fe-c800-415b-932a-2a8d775a7dab tempest-VolumesListAdminTestJSON-1106724458 None] Created volume successfully. Jul 24 15:52:34 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:34 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:35 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.262s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:52:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:52:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Flow 'volume_create_manager' (8c8be3ad-c58e-4456-908b-767d8b8a6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ee5792-91c8-4c6c-b318-e4adc9d46e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ee5792-91c8-4c6c-b318-e4adc9d46e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e307dd-76f4-4fb5-89b6-6832388daf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327492f701ac4bbaafd6b3980572847f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:37Z,use_quota=True,user_id='eebb5ff98a2648a0bad0bdc107822aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b084b7-c84e-4d26-a678-fa84e806d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b084b7-c84e-4d26-a678-fa84e806d67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f863e583-2628-413e-a2e5-6633ec3894fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f863e583-2628-413e-a2e5-6633ec3894fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e307dd-76f4-4fb5-89b6-6832388daf98', 'volume_name': 'volume-38e307dd-76f4-4fb5-89b6-6832388daf98', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76774a3a-4a1a-4bc3-b9f0-a4b6c1c99a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76774a3a-4a1a-4bc3-b9f0-a4b6c1c99a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bf0e5f-45a6-428e-9f1b-1ca33af9b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:36 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Volume 38e307dd-76f4-4fb5-89b6-6832388daf98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e307dd-76f4-4fb5-89b6-6832388daf98', 'volume_size': 1} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e307dd-76f4-4fb5-89b6-6832388daf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327492f701ac4bbaafd6b3980572847f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:37Z,use_quota=True,user_id='eebb5ff98a2648a0bad0bdc107822aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Creating volume 38e307dd-76f4-4fb5-89b6-6832388daf98 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:36 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:36 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 1073741824 Jul 24 15:52:36 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:37 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 1073741824" returned: 0 in 0.530s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:37 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 Jul 24 15:52:37 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:37 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98" returned: 0 in 0.325s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bf0e5f-45a6-428e-9f1b-1ca33af9b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e307dd-76f4-4fb5-89b6-6832388daf98', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db515f27-1684-4445-bda8-9a2298031ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:37 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Volume volume-38e307dd-76f4-4fb5-89b6-6832388daf98 (38e307dd-76f4-4fb5-89b6-6832388daf98): created successfully Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db515f27-1684-4445-bda8-9a2298031ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Flow 'volume_create_manager' (8c8be3ad-c58e-4456-908b-767d8b8a6803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:37 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7436e1bd-938e-466d-8929-4b0c7c7baacf tempest-VolumesListAdminTestJSON-435284357 None] Created volume successfully. Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Flow 'volume_create_manager' (a8b54c47-0a3a-4e1e-84c2-94f2063f78ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eae65c8-f012-4cad-9bec-36a84e89dfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eae65c8-f012-4cad-9bec-36a84e89dfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-743979843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d13b229-c0a7-4f81-8684-3a33fed7080b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e663fb308de7449ebc3bd8c083206baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:38Z,use_quota=True,user_id='9259b8123d844f19a7385d91846148a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc625de-65af-44ac-ba98-2c0f1f2ccddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc625de-65af-44ac-ba98-2c0f1f2ccddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb792374-a013-452b-9f03-21fc08a22529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb792374-a013-452b-9f03-21fc08a22529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d13b229-c0a7-4f81-8684-3a33fed7080b', 'volume_name': 'volume-1d13b229-c0a7-4f81-8684-3a33fed7080b', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27a9d04-6d84-4e7c-8512-ad57e857924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27a9d04-6d84-4e7c-8512-ad57e857924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d482b786-e542-404c-b637-3c9f89e64013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:37 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Volume 1d13b229-c0a7-4f81-8684-3a33fed7080b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d13b229-c0a7-4f81-8684-3a33fed7080b', 'volume_size': 1} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-743979843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d13b229-c0a7-4f81-8684-3a33fed7080b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e663fb308de7449ebc3bd8c083206baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:38Z,use_quota=True,user_id='9259b8123d844f19a7385d91846148a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Creating volume 1d13b229-c0a7-4f81-8684-3a33fed7080b {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:37 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:37 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b 1073741824 Jul 24 15:52:37 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:38 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b 1073741824" returned: 0 in 0.423s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:38 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b Jul 24 15:52:38 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:38 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b" returned: 0 in 0.256s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d482b786-e542-404c-b637-3c9f89e64013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d13b229-c0a7-4f81-8684-3a33fed7080b', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd5e1cf-e198-4431-a48b-0f71bed286c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:38 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Volume volume-1d13b229-c0a7-4f81-8684-3a33fed7080b (1d13b229-c0a7-4f81-8684-3a33fed7080b): created successfully Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd5e1cf-e198-4431-a48b-0f71bed286c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Flow 'volume_create_manager' (a8b54c47-0a3a-4e1e-84c2-94f2063f78ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:38 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-57af869a-b79a-45fd-a518-c6aad2d9c080 tempest-TestMinimumBasicScenario-669171041 None] Created volume successfully. Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Acquiring lock "cinder-38e307dd-76f4-4fb5-89b6-6832388daf98-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Lock "cinder-38e307dd-76f4-4fb5-89b6-6832388daf98-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Acquiring lock "cinder-quobyte-38e307dd-76f4-4fb5-89b6-6832388daf98" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Lock "cinder-quobyte-38e307dd-76f4-4fb5-89b6-6832388daf98" acquired by "delete_volume" :: waited 0.013s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd4d41-8a43-4d2c-95be-9f476c13e38d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "cinder-c034a461-1ba3-4f9f-8fad-b947419d27dc-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-c034a461-1ba3-4f9f-8fad-b947419d27dc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "cinder-quobyte-c034a461-1ba3-4f9f-8fad-b947419d27dc" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-quobyte-c034a461-1ba3-4f9f-8fad-b947419d27dc" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:39 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 Jul 24 15:52:39 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[151215b7-6f0a-4154-8503-e0559b8e3afd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:39 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc Jul 24 15:52:39 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:39 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98" returned: 0 in 0.411s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:39 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98 Jul 24 15:52:39 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:39 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc" returned: 0 in 0.385s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:39 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc Jul 24 15:52:39 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:39 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38e307dd-76f4-4fb5-89b6-6832388daf98" returned: 0 in 0.275s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Lock "cinder-quobyte-38e307dd-76f4-4fb5-89b6-6832388daf98" released by "delete_volume" :: held 0.744s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Created reservations ['3c2f21ab-3a38-41bf-b1dd-1df449a93348', '187fbb2c-3958-4478-bb0a-4a992f5160e7', '2c6aaf13-4ada-46dd-9683-3a4d76f1d216', 'e4079d78-2299-4f90-b728-f460a1aa9ab7'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:39 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c034a461-1ba3-4f9f-8fad-b947419d27dc" returned: 0 in 0.329s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-quobyte-c034a461-1ba3-4f9f-8fad-b947419d27dc" released by "delete_volume" :: held 0.764s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:39 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:39 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Created reservations ['2e82a3af-a01c-438f-8495-d93634785fce', '00030dca-a82d-4b8e-803e-d5ce73e2da17', '2f52bf84-32d3-4432-bd7d-5b68ab23f0a6', '2a4ca398-17f3-44b4-a708-54b02c2f32c2'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:40 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:40 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:40 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.463s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:40 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Deleted volume successfully. Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "cinder-841e5747-93c1-4228-9fe7-4917bfd5dd6c-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-373303d3-6937-44aa-9004-27e6688daa1f tempest-VolumesListAdminTestJSON-435284357 None] Lock "cinder-38e307dd-76f4-4fb5-89b6-6832388daf98-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-841e5747-93c1-4228-9fe7-4917bfd5dd6c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:40 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.413s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:40 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Deleted volume successfully. Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "cinder-quobyte-841e5747-93c1-4228-9fe7-4917bfd5dd6c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-quobyte-841e5747-93c1-4228-9fe7-4917bfd5dd6c" acquired by "delete_volume" :: waited 0.038s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-141701e6-5d37-41ba-9ef7-175e5acef1e1 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-c034a461-1ba3-4f9f-8fad-b947419d27dc-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4a12c2-a6b2-4249-bc4c-124b4a4c07e8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:40 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c Jul 24 15:52:40 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:40 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c" returned: 0 in 0.480s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:41 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c Jul 24 15:52:41 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-7017f4eb-3a02-416d-a70d-5cfce53c46f1 req-d8e36423-f20c-484a-ac33-625a44a008bd tempest-TestMinimumBasicScenario-669171041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-7017f4eb-3a02-416d-a70d-5cfce53c46f1 req-d8e36423-f20c-484a-ac33-625a44a008bd tempest-TestMinimumBasicScenario-669171041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-7017f4eb-3a02-416d-a70d-5cfce53c46f1 req-d8e36423-f20c-484a-ac33-625a44a008bd tempest-TestMinimumBasicScenario-669171041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-7017f4eb-3a02-416d-a70d-5cfce53c46f1 req-d8e36423-f20c-484a-ac33-625a44a008bd tempest-TestMinimumBasicScenario-669171041 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-1d13b229-c0a7-4f81-8684-3a33fed7080b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51685473-9ea1-4763-995c-be3b0463f8c7', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:52:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-7017f4eb-3a02-416d-a70d-5cfce53c46f1 req-d8e36423-f20c-484a-ac33-625a44a008bd tempest-TestMinimumBasicScenario-669171041 None] attachment_update completed successfully. Jul 24 15:52:41 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-841e5747-93c1-4228-9fe7-4917bfd5dd6c" returned: 0 in 0.304s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-quobyte-841e5747-93c1-4228-9fe7-4917bfd5dd6c" released by "delete_volume" :: held 0.830s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Created reservations ['29af4b82-c480-4926-a032-22165f08b867', '17bf318b-7f2c-43d0-b7c7-3830c6af2fba', '5b969758-2dde-4cae-a87a-16a07cf710f1', '08356046-ef3f-4030-a784-ad17f3f1bbf4'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:41 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:41 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "cinder-21a36fd1-8824-42c4-87e8-473aec9c9d18-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-21a36fd1-8824-42c4-87e8-473aec9c9d18-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "cinder-quobyte-21a36fd1-8824-42c4-87e8-473aec9c9d18" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-quobyte-21a36fd1-8824-42c4-87e8-473aec9c9d18" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[03755387-3418-491a-b700-82b35258603f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:41 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.411s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Deleted volume successfully. Jul 24 15:52:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d4ab829a-bb12-4e75-920f-11a9e18a1e7e tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-841e5747-93c1-4228-9fe7-4917bfd5dd6c-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:41 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 Jul 24 15:52:41 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:42 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18" returned: 0 in 0.437s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:42 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18 Jul 24 15:52:42 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:42 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-21a36fd1-8824-42c4-87e8-473aec9c9d18" returned: 0 in 0.282s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-quobyte-21a36fd1-8824-42c4-87e8-473aec9c9d18" released by "delete_volume" :: held 0.765s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Created reservations ['7d89906e-94fb-4826-a535-09bbbe60ded2', '5ce8225b-0807-4513-8be8-c5672473ed43', 'e897a58e-fa45-4250-9327-e76333765f78', 'fc5fe493-f7c4-494b-aff8-106c40f1ee3e'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:42 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:42 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:43 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.317s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:43 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:43 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Deleted volume successfully. Jul 24 15:52:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2bc0af34-46a2-4649-bca5-5dfee0ed1cb2 tempest-VolumesListAdminTestJSON-1106724458 None] Lock "cinder-21a36fd1-8824-42c4-87e8-473aec9c9d18-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Flow 'volume_create_manager' (8756d624-333c-4e82-91f0-ed5df021e793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5449467-68a5-4c23-89a5-c33e13a3b04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5449467-68a5-4c23-89a5-c33e13a3b04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1924680568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e6c0a4-52de-402e-80da-fd8833a40538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602ee738a8b4d2f9614547c8fd19248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:49Z,use_quota=True,user_id='f2850f2bfe4146949ebeec2fdb0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca405cd7-498d-461c-a67a-8c6e77a420ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca405cd7-498d-461c-a67a-8c6e77a420ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45945a7d-409c-4480-bf97-c4ccdc589067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45945a7d-409c-4480-bf97-c4ccdc589067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e6c0a4-52de-402e-80da-fd8833a40538', 'volume_name': 'volume-71e6c0a4-52de-402e-80da-fd8833a40538', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01549195-0d9c-446a-ae7e-3eda9234ffb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01549195-0d9c-446a-ae7e-3eda9234ffb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b065093-814d-4e01-abd6-6c42174fc414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Volume 71e6c0a4-52de-402e-80da-fd8833a40538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e6c0a4-52de-402e-80da-fd8833a40538', 'volume_size': 1} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1924680568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e6c0a4-52de-402e-80da-fd8833a40538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602ee738a8b4d2f9614547c8fd19248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:49Z,use_quota=True,user_id='f2850f2bfe4146949ebeec2fdb0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Creating volume 71e6c0a4-52de-402e-80da-fd8833a40538 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:49 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:49 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 1073741824 Jul 24 15:52:49 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:49 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 1073741824" returned: 0 in 0.509s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:49 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 Jul 24 15:52:49 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:50 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538" returned: 0 in 0.269s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b065093-814d-4e01-abd6-6c42174fc414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e6c0a4-52de-402e-80da-fd8833a40538', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234f33f9-1d89-424e-9392-9650b3af5466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Volume volume-71e6c0a4-52de-402e-80da-fd8833a40538 (71e6c0a4-52de-402e-80da-fd8833a40538): created successfully Jul 24 15:52:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234f33f9-1d89-424e-9392-9650b3af5466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Flow 'volume_create_manager' (8756d624-333c-4e82-91f0-ed5df021e793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5ba38ec2-77f4-41b1-81c3-29ef54229e8b tempest-VolumesTransfersTest-91744413 None] Created volume successfully. Jul 24 15:52:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-452e1daf-0817-48be-8c1d-17222ff07d87 tempest-VolumesTransfersTest-1591880545 None] Transfer volume completed successfully. Jul 24 15:52:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Acquiring lock "cinder-71e6c0a4-52de-402e-80da-fd8833a40538-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Lock "cinder-71e6c0a4-52de-402e-80da-fd8833a40538-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Acquiring lock "cinder-quobyte-71e6c0a4-52de-402e-80da-fd8833a40538" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Lock "cinder-quobyte-71e6c0a4-52de-402e-80da-fd8833a40538" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:52 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b68f6b-16dd-4b91-b7e1-d5f5ce9e4dd3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:52 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 Jul 24 15:52:52 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:52 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538" returned: 0 in 0.364s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:52 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538 Jul 24 15:52:52 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:53 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-71e6c0a4-52de-402e-80da-fd8833a40538" returned: 0 in 0.243s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Lock "cinder-quobyte-71e6c0a4-52de-402e-80da-fd8833a40538" released by "delete_volume" :: held 0.647s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Created reservations ['1a01d8e9-4baf-4a78-ad2f-e6477f9ae2b7', '1b4fd95f-41fa-4ff8-a8f1-9f1f7c4efbb2', '54d48362-7537-4fcf-9194-b35b1704d43d', '14bf5d5c-641a-468d-8f36-e0af33131c2f'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:53 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:53 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:53 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.242s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Deleted volume successfully. Jul 24 15:52:53 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0e9a626d-6269-4ff4-9b8a-df300c881ff2 tempest-VolumesTransfersTest-1506524342 None] Lock "cinder-71e6c0a4-52de-402e-80da-fd8833a40538-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Flow 'volume_create_manager' (df7e3e8a-dd94-41a3-bfea-8ff92e526cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd76fad-fe92-48ed-b362-9fe4baffa02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd76fad-fe92-48ed-b362-9fe4baffa02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-887489154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c43a6f-3ef9-4520-8308-8b43d4d0aae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602ee738a8b4d2f9614547c8fd19248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:54Z,use_quota=True,user_id='f2850f2bfe4146949ebeec2fdb0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9e8056-65b4-4922-84ea-28d78586ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9e8056-65b4-4922-84ea-28d78586ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96446c94-d729-414f-93bc-a73ada3ef0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96446c94-d729-414f-93bc-a73ada3ef0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c43a6f-3ef9-4520-8308-8b43d4d0aae9', 'volume_name': 'volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83721acc-6565-4b0c-b2a3-6537e694fb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83721acc-6565-4b0c-b2a3-6537e694fb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca961cd7-47bc-48fc-89ec-387bf81b0576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:54 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Volume 38c43a6f-3ef9-4520-8308-8b43d4d0aae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9', 'volume_size': 1} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-887489154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c43a6f-3ef9-4520-8308-8b43d4d0aae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602ee738a8b4d2f9614547c8fd19248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:54Z,use_quota=True,user_id='f2850f2bfe4146949ebeec2fdb0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Creating volume 38c43a6f-3ef9-4520-8308-8b43d4d0aae9 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:54 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:54 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 1073741824 Jul 24 15:52:54 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:54 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 1073741824" returned: 0 in 0.454s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:54 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 Jul 24 15:52:54 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:54 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9" returned: 0 in 0.274s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca961cd7-47bc-48fc-89ec-387bf81b0576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb51f56-3d07-42f1-8be8-2abe0f104823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:54 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Volume volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 (38c43a6f-3ef9-4520-8308-8b43d4d0aae9): created successfully Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb51f56-3d07-42f1-8be8-2abe0f104823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Flow 'volume_create_manager' (df7e3e8a-dd94-41a3-bfea-8ff92e526cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-41891949-d525-4afc-91a8-6ded814553b4 tempest-VolumesTransfersTest-91744413 None] Created volume successfully. Jul 24 15:52:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Acquiring lock "cinder-38c43a6f-3ef9-4520-8308-8b43d4d0aae9-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Lock "cinder-38c43a6f-3ef9-4520-8308-8b43d4d0aae9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Acquiring lock "cinder-quobyte-38c43a6f-3ef9-4520-8308-8b43d4d0aae9" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Lock "cinder-quobyte-38c43a6f-3ef9-4520-8308-8b43d4d0aae9" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:55 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab65dd2f-e0c3-4ed5-9c39-d6fc411e4a07]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:55 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 Jul 24 15:52:55 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:55 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9" returned: 0 in 0.381s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:55 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9 Jul 24 15:52:55 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:56 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-38c43a6f-3ef9-4520-8308-8b43d4d0aae9" returned: 0 in 0.252s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Lock "cinder-quobyte-38c43a6f-3ef9-4520-8308-8b43d4d0aae9" released by "delete_volume" :: held 0.679s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Created reservations ['01be8abb-a657-405f-af22-f3fe99ab04c7', 'b36c4eb0-e229-49b4-990e-afafc839162b', '3d710ebe-cf2c-4fff-be0c-8e70f9a1b5fd', 'ecb7cdde-7860-4d67-8b7b-f18145274da9'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:56 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:52:56 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:56 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.258s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Deleted volume successfully. Jul 24 15:52:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-32905d95-35e9-48a8-bf74-f33e9cbd7fa6 tempest-VolumesTransfersTest-1506524342 None] Lock "cinder-38c43a6f-3ef9-4520-8308-8b43d4d0aae9-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Flow 'volume_create_manager' (9eebe4ac-1691-4d2d-b502-8dd3c19d7019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0a1967-82a5-4b8b-a084-7bbffce76030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0a1967-82a5-4b8b-a084-7bbffce76030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1959163455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff4bf71-eeb1-44a8-b2c2-28a37f85266a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a483c03094146a44a1701d0dd7214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:04Z,use_quota=True,user_id='4d3b3c7ccbc4410a8d7cbab677458cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a9cd3f-264a-4b54-ae4d-60b9d491381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a9cd3f-264a-4b54-ae4d-60b9d491381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8cb609-9ad7-4107-9eff-b91ab1fa8300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8cb609-9ad7-4107-9eff-b91ab1fa8300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff4bf71-eeb1-44a8-b2c2-28a37f85266a', 'volume_name': 'volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ac34e5-eef4-42e8-9239-57b4a21033c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ac34e5-eef4-42e8-9239-57b4a21033c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f363fe42-abd4-4e68-902f-71d900d38697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Volume cff4bf71-eeb1-44a8-b2c2-28a37f85266a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a', 'volume_size': 1} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1959163455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff4bf71-eeb1-44a8-b2c2-28a37f85266a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a483c03094146a44a1701d0dd7214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:04Z,use_quota=True,user_id='4d3b3c7ccbc4410a8d7cbab677458cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Creating volume cff4bf71-eeb1-44a8-b2c2-28a37f85266a {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:04 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:04 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a 1073741824 Jul 24 15:53:04 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:04 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a 1073741824" returned: 0 in 0.516s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:04 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a Jul 24 15:53:04 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:05 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f363fe42-abd4-4e68-902f-71d900d38697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96ee020-63da-47ad-93b7-ba25ed6570eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Volume volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a (cff4bf71-eeb1-44a8-b2c2-28a37f85266a): created successfully Jul 24 15:53:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96ee020-63da-47ad-93b7-ba25ed6570eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Flow 'volume_create_manager' (9eebe4ac-1691-4d2d-b502-8dd3c19d7019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-05f36b27-2246-4f80-8651-03a7bd240362 tempest-VolumesTransfersV355Test-1598554842 None] Created volume successfully. Jul 24 15:53:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-4643ccea-bb3c-4ef2-a1b7-d28d61b9b988 tempest-VolumesTransfersV355Test-400758837 None] Transfer volume completed successfully. Jul 24 15:53:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Acquiring lock "cinder-cff4bf71-eeb1-44a8-b2c2-28a37f85266a-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Lock "cinder-cff4bf71-eeb1-44a8-b2c2-28a37f85266a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Acquiring lock "cinder-quobyte-cff4bf71-eeb1-44a8-b2c2-28a37f85266a" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Lock "cinder-quobyte-cff4bf71-eeb1-44a8-b2c2-28a37f85266a" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[371ee942-1f9b-4201-ad16-150e05f5d966]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:07 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a Jul 24 15:53:07 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:07 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a" returned: 0 in 0.368s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:07 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a Jul 24 15:53:07 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:08 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cff4bf71-eeb1-44a8-b2c2-28a37f85266a" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Lock "cinder-quobyte-cff4bf71-eeb1-44a8-b2c2-28a37f85266a" released by "delete_volume" :: held 0.682s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Created reservations ['8c2c7d8c-28cd-4f22-aeea-eb3afe92555c', 'f6c9256e-895b-4c5e-a318-a05ccbd538ce', '1e8d428d-cfed-4ddf-915a-34a81ddf505e', 'a820594c-0262-4809-9cfa-cfa121782ec3'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:08 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:53:08 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:08 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.281s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:08 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Deleted volume successfully. Jul 24 15:53:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6ab316e4-7724-414d-8128-61e282e10911 tempest-VolumesTransfersV355Test-1908803046 None] Lock "cinder-cff4bf71-eeb1-44a8-b2c2-28a37f85266a-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Flow 'volume_create_manager' (9a0dd60c-ebff-4291-88c7-3c749e3933a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a885ea7f-a5de-4e88-8381-d000b30618da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a885ea7f-a5de-4e88-8381-d000b30618da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-850859167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6819bcc4-af0c-4b13-a32f-85cf84c4c264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a483c03094146a44a1701d0dd7214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:09Z,use_quota=True,user_id='4d3b3c7ccbc4410a8d7cbab677458cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08caf8be-b1a7-4b87-9c0d-eb85f4198b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08caf8be-b1a7-4b87-9c0d-eb85f4198b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bec710-3c1a-4f7b-9430-96489b319323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bec710-3c1a-4f7b-9430-96489b319323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6819bcc4-af0c-4b13-a32f-85cf84c4c264', 'volume_name': 'volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f672d4-2b7e-481a-af03-0fb5900d4a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f672d4-2b7e-481a-af03-0fb5900d4a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb4a3d7-7c6b-4f48-9d03-39f673817ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:09 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Volume 6819bcc4-af0c-4b13-a32f-85cf84c4c264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264', 'volume_size': 1} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-850859167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6819bcc4-af0c-4b13-a32f-85cf84c4c264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a483c03094146a44a1701d0dd7214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:09Z,use_quota=True,user_id='4d3b3c7ccbc4410a8d7cbab677458cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Creating volume 6819bcc4-af0c-4b13-a32f-85cf84c4c264 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:09 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:09 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 1073741824 Jul 24 15:53:09 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:09 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 1073741824" returned: 0 in 0.454s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:09 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 Jul 24 15:53:09 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:09 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264" returned: 0 in 0.256s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb4a3d7-7c6b-4f48-9d03-39f673817ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccf0d57-024e-449f-9e36-4384c5fac812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:10 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Volume volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 (6819bcc4-af0c-4b13-a32f-85cf84c4c264): created successfully Jul 24 15:53:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccf0d57-024e-449f-9e36-4384c5fac812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Flow 'volume_create_manager' (9a0dd60c-ebff-4291-88c7-3c749e3933a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:10 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5ba0c6d2-bb95-42fa-a6a8-da33ceb6d5dd tempest-VolumesTransfersV355Test-1598554842 None] Created volume successfully. Jul 24 15:53:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Acquiring lock "cinder-6819bcc4-af0c-4b13-a32f-85cf84c4c264-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Lock "cinder-6819bcc4-af0c-4b13-a32f-85cf84c4c264-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Acquiring lock "cinder-quobyte-6819bcc4-af0c-4b13-a32f-85cf84c4c264" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Lock "cinder-quobyte-6819bcc4-af0c-4b13-a32f-85cf84c4c264" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f388ae-a1ee-4209-a7ea-42139ce907a8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:11 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 Jul 24 15:53:11 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:12 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264" returned: 0 in 0.403s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:12 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264 Jul 24 15:53:12 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:12 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6819bcc4-af0c-4b13-a32f-85cf84c4c264" returned: 0 in 0.259s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Lock "cinder-quobyte-6819bcc4-af0c-4b13-a32f-85cf84c4c264" released by "delete_volume" :: held 0.709s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Created reservations ['99818d78-260b-419b-b5f9-8bcebfa0577b', '9d468059-c2a6-4047-b6ad-bff74089a0be', 'f8293ba1-824f-4833-a5b2-66a6b65305fe', 'd93a2afd-7fce-43f7-a958-74eeddbe9ee6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:12 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:53:12 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:12 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.295s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Deleted volume successfully. Jul 24 15:53:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-95712974-75a7-4b83-9e36-695edc7ce07b tempest-VolumesTransfersV355Test-1908803046 None] Lock "cinder-6819bcc4-af0c-4b13-a32f-85cf84c4c264-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Flow 'volume_create_manager' (3bb4c201-1b14-4a2b-8cb1-19f510bed603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987a6118-9257-4ae8-8ae7-96c7919e8279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987a6118-9257-4ae8-8ae7-96c7919e8279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1240188939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4b54a2-ebae-4149-a32b-27e7359c9b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1924551ca8ae48109e868e258b4639e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:20Z,use_quota=True,user_id='a9eaae28b42342cca97d86185d423bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72b7f97-069e-4e90-b2b1-8369e039efd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72b7f97-069e-4e90-b2b1-8369e039efd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ff5106-34f4-41a1-8ace-c66cdf46a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ff5106-34f4-41a1-8ace-c66cdf46a081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4b54a2-ebae-4149-a32b-27e7359c9b75', 'volume_name': 'volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d1322f-704a-4a39-8631-8ee6245b6866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d1322f-704a-4a39-8631-8ee6245b6866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94773f61-ed16-4d2f-b0ce-bc81af1b9196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:19 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Volume 1e4b54a2-ebae-4149-a32b-27e7359c9b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75', 'volume_size': 1} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1240188939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4b54a2-ebae-4149-a32b-27e7359c9b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1924551ca8ae48109e868e258b4639e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:20Z,use_quota=True,user_id='a9eaae28b42342cca97d86185d423bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Creating volume 1e4b54a2-ebae-4149-a32b-27e7359c9b75 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:19 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:53:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:19 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 1073741824 Jul 24 15:53:19 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:20 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 1073741824" returned: 0 in 0.439s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:20 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 Jul 24 15:53:20 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:20 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75" returned: 0 in 0.237s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94773f61-ed16-4d2f-b0ce-bc81af1b9196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde1ceb9-d390-4231-a81f-d2e81a395628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:20 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Volume volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 (1e4b54a2-ebae-4149-a32b-27e7359c9b75): created successfully Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde1ceb9-d390-4231-a81f-d2e81a395628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Flow 'volume_create_manager' (3bb4c201-1b14-4a2b-8cb1-19f510bed603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:20 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bb49f8a2-257e-4a84-9554-3474108b61c7 tempest-VolumesTransfersV357Test-494778467 None] Created volume successfully. Jul 24 15:53:21 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2cf67140-43a9-4ac1-8aaa-abf16b8930ee tempest-VolumesTransfersV357Test-755973334 None] Transfer volume completed successfully. Jul 24 15:53:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Acquiring lock "cinder-1e4b54a2-ebae-4149-a32b-27e7359c9b75-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Lock "cinder-1e4b54a2-ebae-4149-a32b-27e7359c9b75-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Acquiring lock "cinder-quobyte-1e4b54a2-ebae-4149-a32b-27e7359c9b75" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Lock "cinder-quobyte-1e4b54a2-ebae-4149-a32b-27e7359c9b75" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02894c3-3d80-44c5-ba72-55aa85ed8d6f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:22 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 Jul 24 15:53:22 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75" returned: 0 in 0.350s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:22 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75 Jul 24 15:53:22 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1e4b54a2-ebae-4149-a32b-27e7359c9b75" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Lock "cinder-quobyte-1e4b54a2-ebae-4149-a32b-27e7359c9b75" released by "delete_volume" :: held 0.651s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Created reservations ['2707d2bb-a0c5-467f-ad72-d15e129e32a3', '41992584-df2d-4705-bb26-28218c48cc6a', 'd1051f36-b7b4-4c3d-93f3-a45c2064fd46', 'f65d0eb5-3d74-4f54-b667-7c61987403a9'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:22 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:53:22 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.249s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:22 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Deleted volume successfully. Jul 24 15:53:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-26b3a874-f619-44dd-b446-a6e19a397db9 tempest-VolumesTransfersV357Test-1434995522 None] Lock "cinder-1e4b54a2-ebae-4149-a32b-27e7359c9b75-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Flow 'volume_create_manager' (802b83fb-8e02-411c-a561-a1955b78eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91e7ca6-dcfc-41c5-8f26-eba0f8f5fb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91e7ca6-dcfc-41c5-8f26-eba0f8f5fb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1591715537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad564851-c677-44b2-be6e-8300100c1685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1924551ca8ae48109e868e258b4639e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:23Z,use_quota=True,user_id='a9eaae28b42342cca97d86185d423bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf8e3dd-9f52-4510-8249-41e9a5638382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf8e3dd-9f52-4510-8249-41e9a5638382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d664d5-4c4b-48df-88d1-90adcfbca423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d664d5-4c4b-48df-88d1-90adcfbca423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad564851-c677-44b2-be6e-8300100c1685', 'volume_name': 'volume-ad564851-c677-44b2-be6e-8300100c1685', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01197787-e252-4405-a9f6-3005442d93ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01197787-e252-4405-a9f6-3005442d93ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b697142b-4c34-4713-afe3-e28c9dcf7ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Volume ad564851-c677-44b2-be6e-8300100c1685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad564851-c677-44b2-be6e-8300100c1685', 'volume_size': 1} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1591715537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad564851-c677-44b2-be6e-8300100c1685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1924551ca8ae48109e868e258b4639e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:23Z,use_quota=True,user_id='a9eaae28b42342cca97d86185d423bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Creating volume ad564851-c677-44b2-be6e-8300100c1685 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:23 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:23 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 1073741824 Jul 24 15:53:23 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:23 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 1073741824" returned: 0 in 0.430s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:24 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 Jul 24 15:53:24 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:24 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685" returned: 0 in 0.246s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b697142b-4c34-4713-afe3-e28c9dcf7ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad564851-c677-44b2-be6e-8300100c1685', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f49a42-0e62-4a9a-be56-c3060c919276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:24 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Volume volume-ad564851-c677-44b2-be6e-8300100c1685 (ad564851-c677-44b2-be6e-8300100c1685): created successfully Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f49a42-0e62-4a9a-be56-c3060c919276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Flow 'volume_create_manager' (802b83fb-8e02-411c-a561-a1955b78eb68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-31455073-8930-42c8-a954-261c6a38cb1d tempest-VolumesTransfersV357Test-494778467 None] Created volume successfully. Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Acquiring lock "cinder-ad564851-c677-44b2-be6e-8300100c1685-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Lock "cinder-ad564851-c677-44b2-be6e-8300100c1685-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Acquiring lock "cinder-quobyte-ad564851-c677-44b2-be6e-8300100c1685" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Lock "cinder-quobyte-ad564851-c677-44b2-be6e-8300100c1685" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb6c1d9-17f9-4828-bce3-16ecd6c080bf]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:25 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 Jul 24 15:53:25 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:25 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685" returned: 0 in 0.429s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:25 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685 Jul 24 15:53:25 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:25 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ad564851-c677-44b2-be6e-8300100c1685" returned: 0 in 0.266s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Lock "cinder-quobyte-ad564851-c677-44b2-be6e-8300100c1685" released by "delete_volume" :: held 0.744s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=79,cinder:INSERT=18,cinder:UPDATE=104,cinder:DELETE=9 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=76,cinder:UPDATE=111,cinder:DELETE=11,cinder:INSERT=29 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Created reservations ['a9bbc0a9-c7e2-4f6f-834f-1cef9621d9fb', '9a9f8b67-1a84-4da2-af6c-6ad33d31e4d0', '0e2edcfc-3bc7-4ee8-a532-66401eaa3d8f', '1ae4acb3-60c2-44f0-b5b7-4f374e241e01'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:25 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:53:25 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:26 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.342s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:26 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Deleted volume successfully. Jul 24 15:53:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-89f6bb22-0714-4c68-af49-67d56abb6b60 tempest-VolumesTransfersV357Test-1434995522 None] Lock "cinder-ad564851-c677-44b2-be6e-8300100c1685-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-3e2a665f-afe6-4431-9a28-6e29863292dc req-eec84b84-2696-4695-85a1-2e2b5ae4637c tempest-TestMinimumBasicScenario-669171041 None] Terminate volume connection completed successfully. Jul 24 15:53:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-3e2a665f-afe6-4431-9a28-6e29863292dc req-eec84b84-2696-4695-85a1-2e2b5ae4637c tempest-TestMinimumBasicScenario-669171041 None] Deleting attachment 51685473-9ea1-4763-995c-be3b0463f8c7. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:53:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Acquiring lock "cinder-1d13b229-c0a7-4f81-8684-3a33fed7080b-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Lock "cinder-1d13b229-c0a7-4f81-8684-3a33fed7080b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Acquiring lock "cinder-quobyte-1d13b229-c0a7-4f81-8684-3a33fed7080b" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Lock "cinder-quobyte-1d13b229-c0a7-4f81-8684-3a33fed7080b" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f73fcf-3230-4051-802f-7617d824e6f7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:31 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b Jul 24 15:53:31 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:31 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b" returned: 0 in 0.371s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:31 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b Jul 24 15:53:31 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:31 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1d13b229-c0a7-4f81-8684-3a33fed7080b" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Lock "cinder-quobyte-1d13b229-c0a7-4f81-8684-3a33fed7080b" released by "delete_volume" :: held 0.669s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Created reservations ['5d20d74f-09e2-4a04-ac0d-0a2b18dab5bc', '367e80af-3eca-4cdb-9d7f-7985da51a7f5', '7b832148-4538-4410-87ec-d7d2794f7601', '42178017-d19e-467f-9a7c-2daa9329e91b'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:31 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:53:31 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:31 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.285s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:31 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Deleted volume successfully. Jul 24 15:53:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-25f9beea-bc0c-414b-a1c6-c35873c597b7 tempest-TestMinimumBasicScenario-669171041 None] Lock "cinder-1d13b229-c0a7-4f81-8684-3a33fed7080b-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:53:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:34 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:53:34 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:35 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.354s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:53:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:53:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:53:41 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=17,cinder:SELECT=11,cinder:INSERT=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:53:41 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=7,cinder:INSERT=7,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Flow 'volume_create_manager' (5549f956-e789-4df5-96ee-5bdd0d7a3fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa422c50-8570-4dbb-9d04-2d7c512e04f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa422c50-8570-4dbb-9d04-2d7c512e04f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-295671757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69f568e-9018-4113-b867-658baff864d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bb915b107342f9803748b390a859b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:55Z,use_quota=True,user_id='ec2dffca812a41b781994e77f89a95a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f750abfc-d844-45b6-8ecc-a504f03a5b33),volume_type_id=f750abfc-d844-45b6-8ecc-a504f03a5b33)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d39925-1e4b-4e7f-b73b-aab9f755f6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d39925-1e4b-4e7f-b73b-aab9f755f6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c270e587-1565-4fee-a03c-3073ca09df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c270e587-1565-4fee-a03c-3073ca09df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69f568e-9018-4113-b867-658baff864d2', 'volume_name': 'volume-b69f568e-9018-4113-b867-658baff864d2', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98be3e33-9c3a-44be-a490-fd9dfaa63b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98be3e33-9c3a-44be-a490-fd9dfaa63b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d447665b-a42d-46f2-8a81-c18bad63713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Volume b69f568e-9018-4113-b867-658baff864d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69f568e-9018-4113-b867-658baff864d2', 'volume_size': 1} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-295671757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69f568e-9018-4113-b867-658baff864d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bb915b107342f9803748b390a859b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:55Z,use_quota=True,user_id='ec2dffca812a41b781994e77f89a95a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f750abfc-d844-45b6-8ecc-a504f03a5b33),volume_type_id=f750abfc-d844-45b6-8ecc-a504f03a5b33)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Creating volume b69f568e-9018-4113-b867-658baff864d2 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:55 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:55 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 1073741824 Jul 24 15:53:55 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Flow 'volume_create_manager' (832ce878-5f64-4fba-be6e-00bde63443b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03c33bc-112a-4aca-be48-daf63383ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03c33bc-112a-4aca-be48-daf63383ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-910307921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bb915b107342f9803748b390a859b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:56Z,use_quota=True,user_id='ec2dffca812a41b781994e77f89a95a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35e98570-bf90-4b0b-a54b-bdea98575fe5),volume_type_id=35e98570-bf90-4b0b-a54b-bdea98575fe5)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19366b96-84d3-47e0-8099-0c9eccf296a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19366b96-84d3-47e0-8099-0c9eccf296a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af07e15-295a-4acd-b186-155e38ae44d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af07e15-295a-4acd-b186-155e38ae44d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b', 'volume_name': 'volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3535292-8a7b-484f-8e64-faf54da63002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3535292-8a7b-484f-8e64-faf54da63002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd69a52-a529-4960-8b38-0d076f1d242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Volume b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b', 'volume_size': 1} Jul 24 15:53:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:56 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 1073741824" returned: 0 in 0.652s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:56 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 Jul 24 15:53:56 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:56 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2" returned: 0 in 0.339s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-910307921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bb915b107342f9803748b390a859b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:56Z,use_quota=True,user_id='ec2dffca812a41b781994e77f89a95a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35e98570-bf90-4b0b-a54b-bdea98575fe5),volume_type_id=35e98570-bf90-4b0b-a54b-bdea98575fe5)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Creating volume b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:56 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d447665b-a42d-46f2-8a81-c18bad63713a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69f568e-9018-4113-b867-658baff864d2', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:56 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b 1073741824 Jul 24 15:53:56 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d3a0d9-2afb-4930-946c-216c989fb60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:56 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Volume volume-b69f568e-9018-4113-b867-658baff864d2 (b69f568e-9018-4113-b867-658baff864d2): created successfully Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d3a0d9-2afb-4930-946c-216c989fb60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Flow 'volume_create_manager' (5549f956-e789-4df5-96ee-5bdd0d7a3fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2e8b8e14-61c6-4ced-877c-ca295d95795c tempest-TestInstancesWithCinderVolumes-561952534 None] Created volume successfully. Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Flow 'volume_create_manager' (9beb745b-395e-4354-87bd-564df146f821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f878ef-77f8-4def-91fb-07f2f6728c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f878ef-77f8-4def-91fb-07f2f6728c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1589363919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bb915b107342f9803748b390a859b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:57Z,use_quota=True,user_id='ec2dffca812a41b781994e77f89a95a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9eb2234-1ce5-4225-8c73-ca0e458939d9),volume_type_id=d9eb2234-1ce5-4225-8c73-ca0e458939d9)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205bc8d6-0baa-4120-86d3-702c2556136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205bc8d6-0baa-4120-86d3-702c2556136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1fe0c1-e516-45e3-9e83-41f190b00274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:56 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b 1073741824" returned: 0 in 0.601s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:57 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1fe0c1-e516-45e3-9e83-41f190b00274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7', 'volume_name': 'volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7', 'volume_size': 1, 'image_id': 'a516d30e-c20e-46f8-8903-12d4968edc98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a516d30e-c20e-46f8-8903-12d4968edc98', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1605799578', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02bb915b107342f9803748b390a859b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a516d30e-c20e-46f8-8903-12d4968edc98', 'created_at': datetime.datetime(2026, 7, 24, 13, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a516d30e-c20e-46f8-8903-12d4968edc98/file', 'properties': {}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d133183-f7b6-4643-b13c-ec1bce8fcbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d133183-f7b6-4643-b13c-ec1bce8fcbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c87ee21-86ae-4a9c-a8ba-632d3cda4823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:57 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Volume c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7', 'volume_size': 1, 'image_id': 'a516d30e-c20e-46f8-8903-12d4968edc98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a516d30e-c20e-46f8-8903-12d4968edc98', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1605799578', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02bb915b107342f9803748b390a859b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a516d30e-c20e-46f8-8903-12d4968edc98', 'created_at': datetime.datetime(2026, 7, 24, 13, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a516d30e-c20e-46f8-8903-12d4968edc98/file', 'properties': {}}, 'image_service': } Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Trying to clone c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 from image a516d30e-c20e-46f8-8903-12d4968edc98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a516d30e-c20e-46f8-8903-12d4968edc98', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:57 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b Jul 24 15:53:57 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:57 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b" returned: 0 in 0.302s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd69a52-a529-4960-8b38-0d076f1d242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45314aa-e565-4eae-a2b0-4dfb0be4a570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:57 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Volume volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b (b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b): created successfully Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45314aa-e565-4eae-a2b0-4dfb0be4a570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:57 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Flow 'volume_create_manager' (832ce878-5f64-4fba-be6e-00bde63443b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:57 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a7875deb-093c-44cc-9215-80e6159a18a6 tempest-TestInstancesWithCinderVolumes-561952534 None] Created volume successfully. Jul 24 15:54:00 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD, size 20.69 MB, duration 3.50 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:54:00 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Image download 20.69 MB at 5.90 MB/s Jul 24 15:54:00 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a865b3b-73bf-4cd5-8333-bf6b75f76b60]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:00 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD Jul 24 15:54:00 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:01 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Temporary image a516d30e-c20e-46f8-8903-12d4968edc98 is fetched for user ec2dffca812a41b781994e77f89a95a3. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389bc36-fe2f-4cff-82e9-90feb0a206ef]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:01 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD Jul 24 15:54:01 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:01 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1589363919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bb915b107342f9803748b390a859b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:57Z,use_quota=True,user_id='ec2dffca812a41b781994e77f89a95a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9eb2234-1ce5-4225-8c73-ca0e458939d9),volume_type_id=d9eb2234-1ce5-4225-8c73-ca0e458939d9)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Creating volume c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:01 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:54:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:01 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 1073741824 Jul 24 15:54:01 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:02 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 1073741824" returned: 0 in 0.572s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:02 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 Jul 24 15:54:02 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:02 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7" returned: 0 in 0.285s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Attempting download of a516d30e-c20e-46f8-8903-12d4968edc98 ((None, [{'url': 'file:///opt/stack/data/glance/images/a516d30e-c20e-46f8-8903-12d4968edc98', 'metadata': {}}])) to volume c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc64277-c746-4322-aee9-80fc05391516]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a516d30e-c20e-46f8-8903-12d4968edc98_9x5_y0o4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:02 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a516d30e-c20e-46f8-8903-12d4968edc98_9x5_y0o4 Jul 24 15:54:02 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:02 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a516d30e-c20e-46f8-8903-12d4968edc98_9x5_y0o4" returned: 0 in 0.358s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a516d30e-c20e-46f8-8903-12d4968edc98_9x5_y0o4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:03 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a516d30e-c20e-46f8-8903-12d4968edc98_9x5_y0o4 Jul 24 15:54:03 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:03 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a516d30e-c20e-46f8-8903-12d4968edc98_9x5_y0o4" returned: 1 in 0.366s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a516d30e-c20e-46f8-8903-12d4968edc98_9x5_y0o4' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:54:03 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac037ead-3b67-4bdf-9ab7-91b690042ff9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:03 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD Jul 24 15:54:03 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:03 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:03 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] a516d30e-c20e-46f8-8903-12d4968edc98 was qcow2, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:54:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:03 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 Jul 24 15:54:03 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:05 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7" returned: 0 in 1.910s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a516d30e-c20e-46f8-8903-12d4968edc98_z03fx8xndevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:54:05 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Converted 112.00 MB image at 58.59 MB/s Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:05 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 1G Jul 24 15:54:05 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:05 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 1G" returned: 0 in 0.327s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Downloaded image a516d30e-c20e-46f8-8903-12d4968edc98 ((None, [{'url': 'file:///opt/stack/data/glance/images/a516d30e-c20e-46f8-8903-12d4968edc98', 'metadata': {}}])) to volume c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Temporary image a516d30e-c20e-46f8-8903-12d4968edc98 for user ec2dffca812a41b781994e77f89a95a3 is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Marking volume c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Copying metadata from image a516d30e-c20e-46f8-8903-12d4968edc98 to c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Creating volume glance metadata for volume c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 backed by image a516d30e-c20e-46f8-8903-12d4968edc98 with: {'image_id': 'a516d30e-c20e-46f8-8903-12d4968edc98', 'image_name': 'tempest-scenario-img--1605799578', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c87ee21-86ae-4a9c-a8ba-632d3cda4823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7', 'volume_size': 1, 'image_id': 'a516d30e-c20e-46f8-8903-12d4968edc98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a516d30e-c20e-46f8-8903-12d4968edc98', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1605799578', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02bb915b107342f9803748b390a859b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a516d30e-c20e-46f8-8903-12d4968edc98', 'created_at': datetime.datetime(2026, 7, 24, 13, 53, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a516d30e-c20e-46f8-8903-12d4968edc98/file', 'properties': {}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545ec526-5288-4408-a056-e53552aa44f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Volume volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 (c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7): created successfully Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545ec526-5288-4408-a056-e53552aa44f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Flow 'volume_create_manager' (9beb745b-395e-4354-87bd-564df146f821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-375abb83-1947-496a-802b-fd73963d31fb tempest-TestInstancesWithCinderVolumes-561952534 None] Created volume successfully. Jul 24 15:54:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-fc24f9ff-81c2-4401-abf7-d5e0ab9e9c44 req-41b890c9-8d87-4e87-892e-0bd4e97958d3 tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-fc24f9ff-81c2-4401-abf7-d5e0ab9e9c44 req-41b890c9-8d87-4e87-892e-0bd4e97958d3 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-fc24f9ff-81c2-4401-abf7-d5e0ab9e9c44 req-41b890c9-8d87-4e87-892e-0bd4e97958d3 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-fc24f9ff-81c2-4401-abf7-d5e0ab9e9c44 req-41b890c9-8d87-4e87-892e-0bd4e97958d3 tempest-TestInstancesWithCinderVolumes-561952534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae926b7b-98f7-4605-9731-ce6683b96e9d', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:54:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-fc24f9ff-81c2-4401-abf7-d5e0ab9e9c44 req-41b890c9-8d87-4e87-892e-0bd4e97958d3 tempest-TestInstancesWithCinderVolumes-561952534 None] attachment_update completed successfully. Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Flow 'volume_create_manager' (67bc6199-52ca-48e4-9731-3f5c0aca64ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9482f2e7-fbea-4e2b-ae9b-9b7a694a8c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9482f2e7-fbea-4e2b-ae9b-9b7a694a8c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1871376254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d4af45-4da2-4b22-b8d3-a44217c441bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e2528b757a452abe9bb10daa3f6a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:13Z,use_quota=True,user_id='0e970afe53484850ab3d0fd8af4ad5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d486c083-a824-436e-9ffa-61eed2cc3c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d486c083-a824-436e-9ffa-61eed2cc3c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befea5a1-32c5-4e64-9b4f-dee1b7842d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befea5a1-32c5-4e64-9b4f-dee1b7842d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d4af45-4da2-4b22-b8d3-a44217c441bd', 'volume_name': 'volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee2f36e-fbfb-4c2a-9bd5-0da9e5a5d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee2f36e-fbfb-4c2a-9bd5-0da9e5a5d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0224bc-13a0-4af1-b452-099738914cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:12 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Volume a3d4af45-4da2-4b22-b8d3-a44217c441bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd', 'volume_size': 1} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1871376254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d4af45-4da2-4b22-b8d3-a44217c441bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e2528b757a452abe9bb10daa3f6a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:13Z,use_quota=True,user_id='0e970afe53484850ab3d0fd8af4ad5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Creating volume a3d4af45-4da2-4b22-b8d3-a44217c441bd {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:12 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:54:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:12 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd 1073741824 Jul 24 15:54:12 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Flow 'volume_create_manager' (7b8c694f-9e07-4a9c-aed9-7ec243281144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d9ff1f-e175-4c9d-b8f5-067a6a2de12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d9ff1f-e175-4c9d-b8f5-067a6a2de12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-785553069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbc4cd2-46a2-4478-8ade-fb4d0217e78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e2528b757a452abe9bb10daa3f6a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:13Z,use_quota=True,user_id='0e970afe53484850ab3d0fd8af4ad5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73a9958-55da-449a-99b9-e87eb4a5190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73a9958-55da-449a-99b9-e87eb4a5190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa74c8a-0199-473b-b009-965a56d3e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa74c8a-0199-473b-b009-965a56d3e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbc4cd2-46a2-4478-8ade-fb4d0217e78a', 'volume_name': 'volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22644d7-9044-4493-be9a-57b748bfdff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22644d7-9044-4493-be9a-57b748bfdff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee6bd2a-5445-4b9f-8804-8e277a03ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:13 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Volume 0dbc4cd2-46a2-4478-8ade-fb4d0217e78a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a', 'volume_size': 1} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:13 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd 1073741824" returned: 0 in 0.706s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:13 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd Jul 24 15:54:13 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:13 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd" returned: 0 in 0.318s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-785553069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbc4cd2-46a2-4478-8ade-fb4d0217e78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e2528b757a452abe9bb10daa3f6a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:13Z,use_quota=True,user_id='0e970afe53484850ab3d0fd8af4ad5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Creating volume 0dbc4cd2-46a2-4478-8ade-fb4d0217e78a {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:14 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0224bc-13a0-4af1-b452-099738914cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d12f05-d249-418d-bc0b-527ec891d494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:14 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a 1073741824 Jul 24 15:54:14 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Volume volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd (a3d4af45-4da2-4b22-b8d3-a44217c441bd): created successfully Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d12f05-d249-418d-bc0b-527ec891d494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Flow 'volume_create_manager' (67bc6199-52ca-48e4-9731-3f5c0aca64ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3f85010a-9554-4af4-8d5b-4f970c792019 tempest-TestServerVolumeAttachmentScenario-654527662 None] Created volume successfully. Jul 24 15:54:14 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a 1073741824" returned: 0 in 0.635s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:14 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a Jul 24 15:54:14 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:14 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a" returned: 0 in 0.306s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee6bd2a-5445-4b9f-8804-8e277a03ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dd8027-965a-4497-8608-3d8dd103d50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:15 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Volume volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a (0dbc4cd2-46a2-4478-8ade-fb4d0217e78a): created successfully Jul 24 15:54:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dd8027-965a-4497-8608-3d8dd103d50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Flow 'volume_create_manager' (7b8c694f-9e07-4a9c-aed9-7ec243281144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ebb37c44-4269-4950-91c9-dffae85ccfcd tempest-TestServerVolumeAttachmentScenario-654527662 None] Created volume successfully. Jul 24 15:54:25 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=7 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:54:25 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=16,cinder:SELECT=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:54:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:54:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:34 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:54:34 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:35 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.353s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:54:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:54:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:54:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-420daf4e-08a3-4019-8e5a-15689c4282ae req-c792f83b-5013-4af0-9728-4e601165549e tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-420daf4e-08a3-4019-8e5a-15689c4282ae req-c792f83b-5013-4af0-9728-4e601165549e tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-420daf4e-08a3-4019-8e5a-15689c4282ae req-c792f83b-5013-4af0-9728-4e601165549e tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:48 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-420daf4e-08a3-4019-8e5a-15689c4282ae req-c792f83b-5013-4af0-9728-4e601165549e tempest-TestServerVolumeAttachmentScenario-654527662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c06a6bad-8d00-4c27-ace6-764926daf12b', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:54:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-420daf4e-08a3-4019-8e5a-15689c4282ae req-c792f83b-5013-4af0-9728-4e601165549e tempest-TestServerVolumeAttachmentScenario-654527662 None] attachment_update completed successfully. Jul 24 15:54:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-0aa5f809-0773-4e43-9500-1a6733e4b571 req-17019579-3647-418c-9259-49766dd8ba42 tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-0aa5f809-0773-4e43-9500-1a6733e4b571 req-17019579-3647-418c-9259-49766dd8ba42 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-0aa5f809-0773-4e43-9500-1a6733e4b571 req-17019579-3647-418c-9259-49766dd8ba42 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-0aa5f809-0773-4e43-9500-1a6733e4b571 req-17019579-3647-418c-9259-49766dd8ba42 tempest-TestInstancesWithCinderVolumes-561952534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-b69f568e-9018-4113-b867-658baff864d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7daa2bf6-ebf4-4de1-a247-85bda7f3d2e2', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:54:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-0aa5f809-0773-4e43-9500-1a6733e4b571 req-17019579-3647-418c-9259-49766dd8ba42 tempest-TestInstancesWithCinderVolumes-561952534 None] attachment_update completed successfully. Jul 24 15:54:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4b93689d-a65a-4d1d-bf64-4675c7884b13 req-6faeb1af-6530-4fd0-aaf9-2de6523fd750 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4b93689d-a65a-4d1d-bf64-4675c7884b13 req-6faeb1af-6530-4fd0-aaf9-2de6523fd750 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-4b93689d-a65a-4d1d-bf64-4675c7884b13 req-6faeb1af-6530-4fd0-aaf9-2de6523fd750 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-4b93689d-a65a-4d1d-bf64-4675c7884b13 req-6faeb1af-6530-4fd0-aaf9-2de6523fd750 tempest-TestServerVolumeAttachmentScenario-654527662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b2768f1-0815-4c07-8b85-4dcd93a87627', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:54:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-4b93689d-a65a-4d1d-bf64-4675c7884b13 req-6faeb1af-6530-4fd0-aaf9-2de6523fd750 tempest-TestServerVolumeAttachmentScenario-654527662 None] attachment_update completed successfully. Jul 24 15:54:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-0fcddad6-1ec7-4e45-91ad-f1dafea06a61 req-bf19e5c6-33bc-4252-953e-c2bd74b79dfa tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-0fcddad6-1ec7-4e45-91ad-f1dafea06a61 req-bf19e5c6-33bc-4252-953e-c2bd74b79dfa tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-0fcddad6-1ec7-4e45-91ad-f1dafea06a61 req-bf19e5c6-33bc-4252-953e-c2bd74b79dfa tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-0fcddad6-1ec7-4e45-91ad-f1dafea06a61 req-bf19e5c6-33bc-4252-953e-c2bd74b79dfa tempest-TestInstancesWithCinderVolumes-561952534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87903edb-a0ae-4ed7-b12b-72e5f5ecb4af', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:54:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-0fcddad6-1ec7-4e45-91ad-f1dafea06a61 req-bf19e5c6-33bc-4252-953e-c2bd74b79dfa tempest-TestInstancesWithCinderVolumes-561952534 None] attachment_update completed successfully. Jul 24 15:54:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-a8b61a84-ce2e-4c35-9e95-02f3e575f18b req-d234f414-0975-4ffe-9633-48808ac71297 tempest-TestServerVolumeAttachmentScenario-654527662 None] Terminate volume connection completed successfully. Jul 24 15:54:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-a8b61a84-ce2e-4c35-9e95-02f3e575f18b req-d234f414-0975-4ffe-9633-48808ac71297 tempest-TestServerVolumeAttachmentScenario-654527662 None] Deleting attachment 9b2768f1-0815-4c07-8b85-4dcd93a87627. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:54:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-07bf037f-492d-4592-9771-5a950c7794ce req-cf95f50e-0afb-40f4-8010-c5649f0f6dfc tempest-TestServerVolumeAttachmentScenario-654527662 None] Terminate volume connection completed successfully. Jul 24 15:54:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-07bf037f-492d-4592-9771-5a950c7794ce req-cf95f50e-0afb-40f4-8010-c5649f0f6dfc tempest-TestServerVolumeAttachmentScenario-654527662 None] Deleting attachment c06a6bad-8d00-4c27-ace6-764926daf12b. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:54:59 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-64080e4f-10c0-49e4-9b99-78112b1764d4 req-c2ba7cbc-9de7-4dac-8236-e35925b288d9 tempest-TestInstancesWithCinderVolumes-561952534 None] Terminate volume connection completed successfully. Jul 24 15:54:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-64080e4f-10c0-49e4-9b99-78112b1764d4 req-c2ba7cbc-9de7-4dac-8236-e35925b288d9 tempest-TestInstancesWithCinderVolumes-561952534 None] Deleting attachment 7daa2bf6-ebf4-4de1-a247-85bda7f3d2e2. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:54:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "cinder-b69f568e-9018-4113-b867-658baff864d2-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-b69f568e-9018-4113-b867-658baff864d2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "cinder-quobyte-b69f568e-9018-4113-b867-658baff864d2" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-quobyte-b69f568e-9018-4113-b867-658baff864d2" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a522c175-4190-4613-be8b-f607894af8fa]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "cinder-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "cinder-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:00 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 Jul 24 15:55:00 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "cinder-quobyte-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "cinder-quobyte-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb35144e-31d9-4492-bfeb-a0332f38fe9c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:00 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a Jul 24 15:55:00 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:00 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2" returned: 0 in 0.428s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:00 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2 Jul 24 15:55:00 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:00 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b69f568e-9018-4113-b867-658baff864d2" returned: 0 in 0.278s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:00 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a" returned: 0 in 0.455s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-quobyte-b69f568e-9018-4113-b867-658baff864d2" released by "delete_volume" :: held 0.764s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:00 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a Jul 24 15:55:00 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:00 devstack cinder-volume[88251]: WARNING cinder.quota [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-980857502-230348858 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-980857502-230348858, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:55:00 devstack cinder-volume[88251]: WARNING cinder.quota [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-980857502-230348858 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-980857502-230348858, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Created reservations ['129056e8-f4bf-4c80-b5aa-7e846ffbdc04', '40939b2f-783c-4861-b06d-afd28c2f623b', '172cf39e-2d60-4264-8189-02751efdff86', 'f65dba0d-7c35-4e0a-a10f-757b4844c13c'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:00 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:55:00 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:00 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a" returned: 0 in 0.325s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "cinder-quobyte-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a" released by "delete_volume" :: held 0.834s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Created reservations ['b506b46b-0021-4a7c-94c3-a71c06cb94dc', 'c32536f7-9cd1-4cd7-b0c1-7877b59fcde9', 'e3c74f96-fe02-48f2-9685-d10bd9bcd122', '99ebdb57-ee63-4c8a-a7eb-36dcac0ae25b'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:01 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:55:01 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:01 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.335s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Deleted volume successfully. Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6bc10f61-5f46-48d5-b351-cbe6ddd3deff tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-b69f568e-9018-4113-b867-658baff864d2-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "cinder-a3d4af45-4da2-4b22-b8d3-a44217c441bd-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "cinder-a3d4af45-4da2-4b22-b8d3-a44217c441bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "cinder-quobyte-a3d4af45-4da2-4b22-b8d3-a44217c441bd" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "cinder-quobyte-a3d4af45-4da2-4b22-b8d3-a44217c441bd" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9861e303-7936-4253-a64c-47263ac027f8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:01 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.346s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Deleted volume successfully. Jul 24 15:55:01 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd Jul 24 15:55:01 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc7f5533-bf94-40b1-9952-dbfacb870660 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "cinder-0dbc4cd2-46a2-4478-8ade-fb4d0217e78a-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:01 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd" returned: 0 in 0.399s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:01 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd Jul 24 15:55:01 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:02 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a3d4af45-4da2-4b22-b8d3-a44217c441bd" returned: 0 in 0.282s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "cinder-quobyte-a3d4af45-4da2-4b22-b8d3-a44217c441bd" released by "delete_volume" :: held 0.731s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Created reservations ['5e7d6d0e-5301-471c-9b10-c96f10ef036d', '56fa0c13-f186-4fd8-8e01-a945e0e955ca', '838ea1ff-7a0c-493b-b7da-a7abd3c6ac18', '1ee553e7-6fc0-4b8f-8a0f-fd4b7311e7ea'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:02 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:55:02 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:02 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.262s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:02 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Deleted volume successfully. Jul 24 15:55:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3defc134-c9d1-4718-81ac-20acb59706c0 tempest-TestServerVolumeAttachmentScenario-654527662 None] Lock "cinder-a3d4af45-4da2-4b22-b8d3-a44217c441bd-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:04 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-fb8ee4ab-6e8a-4395-8a08-cf576b7f3a0f req-16bd11d3-3473-4407-b5db-f42fa18adeab tempest-TestInstancesWithCinderVolumes-561952534 None] Terminate volume connection completed successfully. Jul 24 15:55:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-fb8ee4ab-6e8a-4395-8a08-cf576b7f3a0f req-16bd11d3-3473-4407-b5db-f42fa18adeab tempest-TestInstancesWithCinderVolumes-561952534 None] Deleting attachment 87903edb-a0ae-4ed7-b12b-72e5f5ecb4af. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:55:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "cinder-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "cinder-quobyte-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:04 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-quobyte-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:04 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d513e994-7f6a-4a96-9b20-bd1c3e84866e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:04 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b Jul 24 15:55:04 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:05 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b" returned: 0 in 0.463s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:05 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b Jul 24 15:55:05 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:05 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b" returned: 0 in 0.307s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-quobyte-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b" released by "delete_volume" :: held 0.841s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:05 devstack cinder-volume[88251]: WARNING cinder.quota [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1741331992-1089932449 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1741331992-1089932449, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:55:05 devstack cinder-volume[88251]: WARNING cinder.quota [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1741331992-1089932449 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1741331992-1089932449, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Created reservations ['5ddfc8ef-d8ff-4c0d-9f0e-2f0479363fb3', 'e8c8d0fa-6a73-4ffa-b828-cb2ec9fa6b55', 'f47465b6-6cee-4541-b374-17659cd1a37b', '501aec2e-2a56-45c7-822f-2f522b4c18ce'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:05 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:55:05 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:06 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.310s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:06 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Deleted volume successfully. Jul 24 15:55:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7d47ac7e-2797-4b57-834c-cb411f625866 tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-b71f3abc-9fe1-4ff1-ac67-9fbdfe643a6b-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-fdb4f2db-680a-42d8-8bc0-af1d3eb2914c req-011a8a2d-96a1-4955-94f2-cf84ff7c7872 tempest-TestInstancesWithCinderVolumes-561952534 None] Terminate volume connection completed successfully. Jul 24 15:55:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-fdb4f2db-680a-42d8-8bc0-af1d3eb2914c req-011a8a2d-96a1-4955-94f2-cf84ff7c7872 tempest-TestInstancesWithCinderVolumes-561952534 None] Deleting attachment ae926b7b-98f7-4605-9731-ce6683b96e9d. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "cinder-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "cinder-quobyte-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-quobyte-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b193f0-245b-46ca-9225-b80c5be535c4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:10 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 Jul 24 15:55:10 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:10 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7" returned: 0 in 0.400s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:10 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7 Jul 24 15:55:10 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:10 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-quobyte-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7" released by "delete_volume" :: held 0.713s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:10 devstack cinder-volume[88251]: WARNING cinder.quota [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1481496569-1498762861 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1481496569-1498762861, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:55:10 devstack cinder-volume[88251]: WARNING cinder.quota [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1481496569-1498762861 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1481496569-1498762861, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Created reservations ['02aa4c4c-2f00-4b93-b3ae-2c91b8bdc5e6', '15cd9388-bc7e-4c1b-8678-36bc4c21bb9a', 'beaeb6d1-7991-429c-bacf-cf4c4afc406e', '971c1082-294e-41cc-b443-62e78b030692'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:11 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:55:11 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:11 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.283s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:11 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Deleted volume successfully. Jul 24 15:55:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b8c0d10f-69b6-4b20-a21e-dab0e5a205ad tempest-TestInstancesWithCinderVolumes-561952534 None] Lock "cinder-c5bba5ce-6f1f-4f4e-a270-0b3094ee94a7-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:21 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=54,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:55:23 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=59,cinder:UPDATE=54,cinder:INSERT=11,cinder:DELETE=3 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:55:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:55:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:34 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:55:34 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:35 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:55:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:55:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:55:40 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Flow 'volume_create_manager' (8fbed676-2612-489f-b322-53bfcda703a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757139dc-d912-400b-a1ff-efda2fa29ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757139dc-d912-400b-a1ff-efda2fa29ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1127892126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fafab5c-2ea0-4bbf-9681-307e92bfb9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196f5fa7115a4fb88be22b7614cfb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:40Z,use_quota=True,user_id='2b0e24643b53463996e1dc5d96a0571e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2c3e23-fff0-4d1a-97fc-f99d33dc09a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2c3e23-fff0-4d1a-97fc-f99d33dc09a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:40 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e593dc23-798a-4237-af18-0d997ffc4f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:40 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e593dc23-798a-4237-af18-0d997ffc4f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7fafab5c-2ea0-4bbf-9681-307e92bfb9c2', 'volume_name': 'volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155371f7-af7a-4113-afaf-5adc5ea6611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155371f7-af7a-4113-afaf-5adc5ea6611a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a360996-5040-45a9-bfb1-f0e27b5e1267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Volume 7fafab5c-2ea0-4bbf-9681-307e92bfb9c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Trying to clone 7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 from image 2edfa101-a293-4451-bf18-908a0ec01fd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:55:41 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Image download 20.69 MB at 20.69 MB/s Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[25217d18-c73f-4fd5-aaf6-9d8ef5d99cf8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:41 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD Jul 24 15:55:41 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:41 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Temporary image 2edfa101-a293-4451-bf18-908a0ec01fd6 is fetched for user 2b0e24643b53463996e1dc5d96a0571e. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d110f8-2964-462a-a668-4ca456bc9c48]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:42 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD Jul 24 15:55:42 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:42 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1127892126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fafab5c-2ea0-4bbf-9681-307e92bfb9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196f5fa7115a4fb88be22b7614cfb70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:40Z,use_quota=True,user_id='2b0e24643b53463996e1dc5d96a0571e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Creating volume 7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:42 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:42 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 1073741824 Jul 24 15:55:42 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:42 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 1073741824" returned: 0 in 0.548s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:42 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 Jul 24 15:55:42 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:43 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2" returned: 0 in 0.266s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Attempting download of 2edfa101-a293-4451-bf18-908a0ec01fd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}])) to volume 7fafab5c-2ea0-4bbf-9681-307e92bfb9c2. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee52e4b-7508-45bc-8b4e-bd9c4d780f74]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_m89p1q7_ {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:43 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_m89p1q7_ Jul 24 15:55:43 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:43 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_m89p1q7_" returned: 0 in 0.339s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_m89p1q7_ {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:43 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_m89p1q7_ Jul 24 15:55:43 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:43 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_m89p1q7_" returned: 1 in 0.341s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2edfa101-a293-4451-bf18-908a0ec01fd6_m89p1q7_' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d39caf-1d80-4352-a28b-934c4240694a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:44 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD Jul 24 15:55:44 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:44 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:44 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] 2edfa101-a293-4451-bf18-908a0ec01fd6 was qcow2, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:55:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:44 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 Jul 24 15:55:44 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:46 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2" returned: 0 in 1.909s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2edfa101-a293-4451-bf18-908a0ec01fd6_y6v5_suldevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:55:46 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Converted 112.00 MB image at 58.64 MB/s Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:46 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 1G Jul 24 15:55:46 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:46 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 1G" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Downloaded image 2edfa101-a293-4451-bf18-908a0ec01fd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}])) to volume 7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Temporary image 2edfa101-a293-4451-bf18-908a0ec01fd6 for user 2b0e24643b53463996e1dc5d96a0571e is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Marking volume 7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Copying metadata from image 2edfa101-a293-4451-bf18-908a0ec01fd6 to 7fafab5c-2ea0-4bbf-9681-307e92bfb9c2. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Creating volume glance metadata for volume 7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 backed by image 2edfa101-a293-4451-bf18-908a0ec01fd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a360996-5040-45a9-bfb1-f0e27b5e1267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2', 'volume_size': 1, 'image_id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2edfa101-a293-4451-bf18-908a0ec01fd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6df8d02a7b4aa38b190d8d7984a3ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2edfa101-a293-4451-bf18-908a0ec01fd6', 'created_at': datetime.datetime(2026, 7, 24, 13, 32, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2edfa101-a293-4451-bf18-908a0ec01fd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0c9801-9d6c-4b75-a5b6-6e5534bd9ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:46 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Volume volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 (7fafab5c-2ea0-4bbf-9681-307e92bfb9c2): created successfully Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0c9801-9d6c-4b75-a5b6-6e5534bd9ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Flow 'volume_create_manager' (8fbed676-2612-489f-b322-53bfcda703a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-752fecb9-2af1-49f1-8215-dc5cdbf385d0 tempest-TestShelveInstance-2011138646 None] Created volume successfully. Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-9b2d25c6-5240-4d51-9267-10f5333852aa req-762476c3-f642-414d-92bf-dad89abd1d4a tempest-TestShelveInstance-2011138646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-9b2d25c6-5240-4d51-9267-10f5333852aa req-762476c3-f642-414d-92bf-dad89abd1d4a tempest-TestShelveInstance-2011138646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-9b2d25c6-5240-4d51-9267-10f5333852aa req-762476c3-f642-414d-92bf-dad89abd1d4a tempest-TestShelveInstance-2011138646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-9b2d25c6-5240-4d51-9267-10f5333852aa req-762476c3-f642-414d-92bf-dad89abd1d4a tempest-TestShelveInstance-2011138646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e2a17a9-02de-4e0f-8920-38aa14c825e2', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:55:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-9b2d25c6-5240-4d51-9267-10f5333852aa req-762476c3-f642-414d-92bf-dad89abd1d4a tempest-TestShelveInstance-2011138646 None] attachment_update completed successfully. Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Flow 'volume_create_manager' (7b1103d5-0d11-4e04-9d8c-2772e758b6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6691a62b-0461-4069-9163-fd8ee51a9f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6691a62b-0461-4069-9163-fd8ee51a9f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-89234044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff5805d-e914-44f1-a654-2c7d3f970705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d888add111e747ec981618041aa31e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:50Z,use_quota=True,user_id='aafdee9e945d412ea9adfe405e308bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5a17b0-51d0-4578-8566-bc55eb50194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5a17b0-51d0-4578-8566-bc55eb50194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e852bc-1cf1-4c72-a911-bceedfb1ba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e852bc-1cf1-4c72-a911-bceedfb1ba39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff5805d-e914-44f1-a654-2c7d3f970705', 'volume_name': 'volume-6ff5805d-e914-44f1-a654-2c7d3f970705', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1bb8bd-ea1f-4ea8-b8d8-9998d341f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1bb8bd-ea1f-4ea8-b8d8-9998d341f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b56852-45b3-4499-b105-3ce943e8be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Volume 6ff5805d-e914-44f1-a654-2c7d3f970705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff5805d-e914-44f1-a654-2c7d3f970705', 'volume_size': 1} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-89234044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff5805d-e914-44f1-a654-2c7d3f970705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d888add111e747ec981618041aa31e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:50Z,use_quota=True,user_id='aafdee9e945d412ea9adfe405e308bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Creating volume 6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:50 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:55:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:50 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 1073741824 Jul 24 15:55:50 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:51 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 1073741824" returned: 0 in 0.561s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:51 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 Jul 24 15:55:51 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:51 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b56852-45b3-4499-b105-3ce943e8be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff5805d-e914-44f1-a654-2c7d3f970705', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664752ef-5776-442d-8078-6a8a43379c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Volume volume-6ff5805d-e914-44f1-a654-2c7d3f970705 (6ff5805d-e914-44f1-a654-2c7d3f970705): created successfully Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664752ef-5776-442d-8078-6a8a43379c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Flow 'volume_create_manager' (7b1103d5-0d11-4e04-9d8c-2772e758b6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:51 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6c4d025a-2632-46af-b23d-279c4344e57e tempest-TestStampPattern-582885974 None] Created volume successfully. Jul 24 15:56:01 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=18,cinder:UPDATE=9,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:56:01 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=18,cinder:UPDATE=9,cinder:INSERT=10,cinder:DELETE=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:56:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-ba9e77ef-590b-44c9-a790-66789662d055 req-f16be656-ffde-477f-8f35-f1abfe7efca0 tempest-TestShelveInstance-2011138646 None] Terminate volume connection completed successfully. Jul 24 15:56:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-ba9e77ef-590b-44c9-a790-66789662d055 req-f16be656-ffde-477f-8f35-f1abfe7efca0 tempest-TestShelveInstance-2011138646 None] Deleting attachment 5e2a17a9-02de-4e0f-8920-38aa14c825e2. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:56:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-a2dde8c5-387b-4aae-b3a2-a55c62e931cd req-9f8f8bb2-8034-45d9-a6d3-ca22b0b0cbe5 tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-a2dde8c5-387b-4aae-b3a2-a55c62e931cd req-9f8f8bb2-8034-45d9-a6d3-ca22b0b0cbe5 tempest-TestStampPattern-582885974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-a2dde8c5-387b-4aae-b3a2-a55c62e931cd req-9f8f8bb2-8034-45d9-a6d3-ca22b0b0cbe5 tempest-TestStampPattern-582885974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-a2dde8c5-387b-4aae-b3a2-a55c62e931cd req-9f8f8bb2-8034-45d9-a6d3-ca22b0b0cbe5 tempest-TestStampPattern-582885974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-6ff5805d-e914-44f1-a654-2c7d3f970705', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1d3008f-cb8d-4780-ab62-2b92f7af7cbe', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:56:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-a2dde8c5-387b-4aae-b3a2-a55c62e931cd req-9f8f8bb2-8034-45d9-a6d3-ca22b0b0cbe5 tempest-TestStampPattern-582885974 None] attachment_update completed successfully. Jul 24 15:56:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ee161f1e-3a51-41fc-a525-764eeafbea55 req-08277d54-cb5c-4109-85cf-72c16c0cdcb1 tempest-TestShelveInstance-2011138646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ee161f1e-3a51-41fc-a525-764eeafbea55 req-08277d54-cb5c-4109-85cf-72c16c0cdcb1 tempest-TestShelveInstance-2011138646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ee161f1e-3a51-41fc-a525-764eeafbea55 req-08277d54-cb5c-4109-85cf-72c16c0cdcb1 tempest-TestShelveInstance-2011138646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-ee161f1e-3a51-41fc-a525-764eeafbea55 req-08277d54-cb5c-4109-85cf-72c16c0cdcb1 tempest-TestShelveInstance-2011138646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0831452c-1109-4256-a729-be34a9e6c7f6', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:56:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-ee161f1e-3a51-41fc-a525-764eeafbea55 req-08277d54-cb5c-4109-85cf-72c16c0cdcb1 tempest-TestShelveInstance-2011138646 None] attachment_update completed successfully. Jul 24 15:56:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-815c3cc1-4141-456a-b5e4-e4b585c00d33 req-7b12f779-be43-4964-ac03-9b7f108b52ab tempest-TestStampPattern-582885974 None] Terminate volume connection completed successfully. Jul 24 15:56:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-815c3cc1-4141-456a-b5e4-e4b585c00d33 req-7b12f779-be43-4964-ac03-9b7f108b52ab tempest-TestStampPattern-582885974 None] Deleting attachment b1d3008f-cb8d-4780-ab62-2b92f7af7cbe. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:56:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Creating offline snapshot c2ec8e5a-a4d0-4736-832d-92bcbef69976 of volume 6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:56:31 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f32c6ca-15da-405f-b1b5-38333a19c229]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:31 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 Jul 24 15:56:31 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:31 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705" returned: 0 in 0.382s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:31 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 1G Jul 24 15:56:31 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:32 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 1G" returned: 0 in 0.448s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff5805d-e914-44f1-a654-2c7d3f970705 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:32 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff5805d-e914-44f1-a654-2c7d3f970705 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 Jul 24 15:56:32 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:32 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff5805d-e914-44f1-a654-2c7d3f970705 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976" returned: 0 in 0.301s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:32 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 is being set with open permissions: ugo+rw Jul 24 15:56:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:32 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 Jul 24 15:56:32 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:32 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976" returned: 0 in 0.277s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:33 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.info Jul 24 15:56:33 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:33 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.info" returned: 0 in 0.277s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:33 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.info is being set with open permissions: ugo+rw Jul 24 15:56:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:33 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.info Jul 24 15:56:33 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:33 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.info" returned: 0 in 0.264s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:33 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-93ce7dd2-1e05-4071-b1ee-93d0944697e1 tempest-TestStampPattern-582885974 None] Create snapshot completed successfully Jul 24 15:56:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:56:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:34 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:56:34 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:35 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.298s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:56:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:56:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:56:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Flow 'volume_create_manager' (898d6e93-e4cd-4f86-958f-0dfe0de40c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61edb654-05dc-4f2f-a4c2-6bac1fe9628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61edb654-05dc-4f2f-a4c2-6bac1fe9628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-613242922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129beb2f-cc2f-450d-87af-91d47a4f0d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d888add111e747ec981618041aa31e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2ec8e5a-a4d0-4736-832d-92bcbef69976,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:56:41Z,use_quota=True,user_id='aafdee9e945d412ea9adfe405e308bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db5da5d-d33b-43e0-9d1a-6cf9c419bd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db5da5d-d33b-43e0-9d1a-6cf9c419bd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172d3566-b1d4-41d5-8dcd-59b74d54ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172d3566-b1d4-41d5-8dcd-59b74d54ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '129beb2f-cc2f-450d-87af-91d47a4f0d98', 'volume_name': 'volume-129beb2f-cc2f-450d-87af-91d47a4f0d98', 'volume_size': 1, 'snapshot_id': 'c2ec8e5a-a4d0-4736-832d-92bcbef69976'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb1486d-cc32-4a69-a9d2-b9b9526cf63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb1486d-cc32-4a69-a9d2-b9b9526cf63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af435005-22ca-4279-bd0b-f64a06a68386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Volume 129beb2f-cc2f-450d-87af-91d47a4f0d98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-129beb2f-cc2f-450d-87af-91d47a4f0d98', 'volume_size': 1, 'snapshot_id': 'c2ec8e5a-a4d0-4736-832d-92bcbef69976'} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-quobyte-c2ec8e5a-a4d0-4736-832d-92bcbef69976-129beb2f-cc2f-450d-87af-91d47a4f0d98" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-c2ec8e5a-a4d0-4736-832d-92bcbef69976-129beb2f-cc2f-450d-87af-91d47a4f0d98" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Creating volume 129beb2f-cc2f-450d-87af-91d47a4f0d98 from snapshot c2ec8e5a-a4d0-4736-832d-92bcbef69976 {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-quobyte-129beb2f-cc2f-450d-87af-91d47a4f0d98" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-129beb2f-cc2f-450d-87af-91d47a4f0d98" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] snapshot: c2ec8e5a-a4d0-4736-832d-92bcbef69976, volume: 129beb2f-cc2f-450d-87af-91d47a4f0d98, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b798fbf4-7ab5-459d-a010-18de9e312d98]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:41 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 Jul 24 15:56:41 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:42 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976" returned: 0 in 0.410s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ff5805d-e914-44f1-a654-2c7d3f970705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ddb79f-87ff-47b6-b6ca-020aaeb6075a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:42 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 Jul 24 15:56:42 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:42 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705" returned: 0 in 0.438s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:56:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:42 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 Jul 24 15:56:42 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:48 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98" returned: 0 in 5.829s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:48 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[34496d17-ea7c-45de-b434-537beefb3705]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:48 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 Jul 24 15:56:48 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:49 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705" returned: 0 in 0.618s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:56:49 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Converted 1024.00 MB image at 175.63 MB/s Jul 24 15:56:49 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 is being set with open permissions: ugo+rw Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:49 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 Jul 24 15:56:49 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:49 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98" returned: 0 in 0.310s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-129beb2f-cc2f-450d-87af-91d47a4f0d98" released by "_copy_volume_from_snapshot" :: held 7.714s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-c2ec8e5a-a4d0-4736-832d-92bcbef69976-129beb2f-cc2f-450d-87af-91d47a4f0d98" released by "_create_volume_from_snapshot" :: held 7.750s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.770s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af435005-22ca-4279-bd0b-f64a06a68386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129beb2f-cc2f-450d-87af-91d47a4f0d98', 'volume_size': 1, 'snapshot_id': 'c2ec8e5a-a4d0-4736-832d-92bcbef69976'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e5b660-b38c-4d4f-808f-1c3cd28d4fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Volume volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 (129beb2f-cc2f-450d-87af-91d47a4f0d98): created successfully Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e5b660-b38c-4d4f-808f-1c3cd28d4fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Flow 'volume_create_manager' (898d6e93-e4cd-4f86-958f-0dfe0de40c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:56:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-baf0331c-4295-42e5-9a92-e9943b4abcf8 tempest-TestStampPattern-582885974 None] Created volume successfully. Jul 24 15:56:59 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:56:59 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=22,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:57:10 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-d8f2047b-69ad-4160-8696-85ba5e10088c tempest-TestShelveInstance-2011138646 None] Terminate volume connection completed successfully. Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-d8f2047b-69ad-4160-8696-85ba5e10088c tempest-TestShelveInstance-2011138646 None] Deleting attachment 0831452c-1109-4256-a729-be34a9e6c7f6. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Acquiring lock "cinder-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Lock "cinder-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Acquiring lock "cinder-quobyte-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Lock "cinder-quobyte-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[192a7b6c-0b30-4119-a8e1-1666d8db819a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:10 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 Jul 24 15:57:10 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:10 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2" returned: 0 in 0.387s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:10 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2 Jul 24 15:57:10 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:11 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2" returned: 0 in 0.254s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Lock "cinder-quobyte-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2" released by "delete_volume" :: held 0.690s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG cinder.quota [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Created reservations ['85b5ff85-dc94-4744-8519-8d2f522f264f', '2e1ca101-3f3d-4064-9e14-aefd0b88a3fa', '4da01a91-d873-4dbd-b65b-d71e150da3cb', 'a7286684-5a21-4e10-9745-746367bbc540'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:11 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:11 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:11 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.307s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG cinder.manager [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:11 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Deleted volume successfully. Jul 24 15:57:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [req-ebe42e15-77fd-4b09-af17-f47ee6b98875 req-6cfafcbe-9544-42cd-ab33-3d71625522d1 tempest-TestShelveInstance-2011138646 None] Lock "cinder-7fafab5c-2ea0-4bbf-9681-307e92bfb9c2-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (7df345e1-3a2e-47be-9883-2c9f3ecde354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d26f75-97b2-4345-acfc-90c985cd9b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d26f75-97b2-4345-acfc-90c985cd9b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739377700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9c1486-8f0b-4c28-9178-e2808b3a92fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:22Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb6051c-7a0a-465f-afc5-aad4aebbd998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb6051c-7a0a-465f-afc5-aad4aebbd998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d12624-2c83-4197-ad09-f29f22b2beee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d12624-2c83-4197-ad09-f29f22b2beee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9c1486-8f0b-4c28-9178-e2808b3a92fa', 'volume_name': 'volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5a1dba-b4ba-4f2e-ba84-5ab67a698350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5a1dba-b4ba-4f2e-ba84-5ab67a698350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b796b164-a459-47cc-829c-874f67808f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Volume 0b9c1486-8f0b-4c28-9178-e2808b3a92fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa', 'volume_size': 1} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739377700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9c1486-8f0b-4c28-9178-e2808b3a92fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:22Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Creating volume 0b9c1486-8f0b-4c28-9178-e2808b3a92fa {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:21 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:21 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa 1073741824 Jul 24 15:57:21 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (e11a6dd4-a662-42dd-b092-d0feb53a48b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1480f4-c30f-4f90-b495-d27d5a37aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1480f4-c30f-4f90-b495-d27d5a37aee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047146142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:22Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f39092-e633-432f-8c6a-9a33691edab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f39092-e633-432f-8c6a-9a33691edab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a0f8fc-0915-4acb-bea2-7c0773d6440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a0f8fc-0915-4acb-bea2-7c0773d6440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e', 'volume_name': 'volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53530ae-de9e-4555-8688-ac12f2a35e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53530ae-de9e-4555-8688-ac12f2a35e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6ac03d-6e9f-4f92-a2cc-210851b46086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Volume 13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e', 'volume_size': 1} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:22 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa 1073741824" returned: 0 in 0.514s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:22 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa Jul 24 15:57:22 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (cf34c50f-8153-4814-ba7d-2859203f5558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b91200-592e-4c76-a252-25f99cb2ba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b91200-592e-4c76-a252-25f99cb2ba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651349440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e243820-3f72-4a86-91e8-9bad96ad2879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:22Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a878716-f303-4e75-996d-aed6f1401834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a878716-f303-4e75-996d-aed6f1401834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec2f241-916a-4978-838a-6769a197040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec2f241-916a-4978-838a-6769a197040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e243820-3f72-4a86-91e8-9bad96ad2879', 'volume_name': 'volume-9e243820-3f72-4a86-91e8-9bad96ad2879', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a982bf16-23fa-460a-ab10-60a905cb2136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a982bf16-23fa-460a-ab10-60a905cb2136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1fbdcb-32ab-4edf-91c5-15929128cbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Volume 9e243820-3f72-4a86-91e8-9bad96ad2879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e243820-3f72-4a86-91e8-9bad96ad2879', 'volume_size': 1} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:22 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa" returned: 0 in 0.295s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047146142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:22Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Creating volume 13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:22 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b796b164-a459-47cc-829c-874f67808f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663909e2-f3bd-4280-aa72-c35f204d9762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e 1073741824 Jul 24 15:57:22 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:22 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Volume volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa (0b9c1486-8f0b-4c28-9178-e2808b3a92fa): created successfully Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663909e2-f3bd-4280-aa72-c35f204d9762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (7df345e1-3a2e-47be-9883-2c9f3ecde354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:22 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-906e1d11-6d79-4b32-982b-ad16fa208190 tempest-CreateVolumesFromImageTest-1542799502 None] Created volume successfully. Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (10e952fe-3376-4ffc-bf41-7fd177d5aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a8c9b4-5a9c-473e-9496-ca7a743904d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a8c9b4-5a9c-473e-9496-ca7a743904d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1060645729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e7bbbd-be16-44e4-9067-f0ea6ed3deff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:23Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea34a1e-36d2-4e6d-88a0-06692b677b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea34a1e-36d2-4e6d-88a0-06692b677b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec0ef3b-df10-4b6f-902f-aefa53d874bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec0ef3b-df10-4b6f-902f-aefa53d874bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e7bbbd-be16-44e4-9067-f0ea6ed3deff', 'volume_name': 'volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5fbed7-0bcd-478e-8d47-b4fee7d47a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5fbed7-0bcd-478e-8d47-b4fee7d47a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c230ee-15f5-4d39-9495-5b2332907383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Volume a9e7bbbd-be16-44e4-9067-f0ea6ed3deff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff', 'volume_size': 1} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:23 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e 1073741824" returned: 0 in 0.553s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:23 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e Jul 24 15:57:23 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (93f0ee09-1b22-4900-81dc-ebceae128c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff41a1e2-e294-4a31-af7e-1f8765e7ef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff41a1e2-e294-4a31-af7e-1f8765e7ef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968343109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dada7b19-1de1-47a4-b01f-5d3ba46ae302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:23Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd8e437-86b3-467e-b6bb-db96694df3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd8e437-86b3-467e-b6bb-db96694df3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a142fa-3a9d-40fc-951f-c0e7a513011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a142fa-3a9d-40fc-951f-c0e7a513011c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dada7b19-1de1-47a4-b01f-5d3ba46ae302', 'volume_name': 'volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca3984a-6a88-4817-908b-95e2dd9237d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca3984a-6a88-4817-908b-95e2dd9237d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947458dd-a2ab-4c35-9bb8-a297f1cc317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Volume dada7b19-1de1-47a4-b01f-5d3ba46ae302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302', 'volume_size': 1} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:23 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e" returned: 0 in 0.260s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651349440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e243820-3f72-4a86-91e8-9bad96ad2879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:22Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Creating volume 9e243820-3f72-4a86-91e8-9bad96ad2879 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:23 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:23 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 1073741824 Jul 24 15:57:23 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6ac03d-6e9f-4f92-a2cc-210851b46086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18106a5e-d8be-4ad6-baf3-d0210266d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Volume volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e (13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e): created successfully Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18106a5e-d8be-4ad6-baf3-d0210266d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (e11a6dd4-a662-42dd-b092-d0feb53a48b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bd990d76-3f44-49b6-aaa8-e7041f70675b tempest-CreateVolumesFromImageTest-1542799502 None] Created volume successfully. Jul 24 15:57:23 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 1073741824" returned: 0 in 0.425s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:24 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 Jul 24 15:57:24 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:24 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879" returned: 0 in 0.250s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1060645729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e7bbbd-be16-44e4-9067-f0ea6ed3deff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:23Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Creating volume a9e7bbbd-be16-44e4-9067-f0ea6ed3deff {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:24 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1fbdcb-32ab-4edf-91c5-15929128cbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e243820-3f72-4a86-91e8-9bad96ad2879', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:24 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff 1073741824 Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4063cb86-4d43-4d8a-ad32-bdee3768931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:24 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:24 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Volume volume-9e243820-3f72-4a86-91e8-9bad96ad2879 (9e243820-3f72-4a86-91e8-9bad96ad2879): created successfully Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4063cb86-4d43-4d8a-ad32-bdee3768931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (cf34c50f-8153-4814-ba7d-2859203f5558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-db3ade8d-45c9-4dde-9f3d-fcc03613e996 tempest-CreateVolumesFromImageTest-1542799502 None] Created volume successfully. Jul 24 15:57:24 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff 1073741824" returned: 0 in 0.412s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:24 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff Jul 24 15:57:24 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:24 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff" returned: 0 in 0.244s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.570s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968343109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dada7b19-1de1-47a4-b01f-5d3ba46ae302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d380df21c74c7d9de068daf09844a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:23Z,use_quota=True,user_id='b5dbf38a43de47e2b69039155d721932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Creating volume dada7b19-1de1-47a4-b01f-5d3ba46ae302 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:24 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c230ee-15f5-4d39-9495-5b2332907383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:24 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 1073741824 Jul 24 15:57:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06aabd69-f093-40a3-a1b0-082ed1225c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:24 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Volume volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff (a9e7bbbd-be16-44e4-9067-f0ea6ed3deff): created successfully Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06aabd69-f093-40a3-a1b0-082ed1225c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (10e952fe-3376-4ffc-bf41-7fd177d5aa09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-269141ed-cc54-4c93-b4e2-32af440ec22b tempest-CreateVolumesFromImageTest-1542799502 None] Created volume successfully. Jul 24 15:57:25 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 1073741824" returned: 0 in 0.420s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:25 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 Jul 24 15:57:25 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:25 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947458dd-a2ab-4c35-9bb8-a297f1cc317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872e856b-871c-4975-afe7-35b387d0f6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Volume volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 (dada7b19-1de1-47a4-b01f-5d3ba46ae302): created successfully Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872e856b-871c-4975-afe7-35b387d0f6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Flow 'volume_create_manager' (93f0ee09-1b22-4900-81dc-ebceae128c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-28c98312-48d2-4e5e-a5dd-001267dd1939 tempest-CreateVolumesFromImageTest-1542799502 None] Created volume successfully. Jul 24 15:57:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-dada7b19-1de1-47a4-b01f-5d3ba46ae302-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-dada7b19-1de1-47a4-b01f-5d3ba46ae302-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-quobyte-dada7b19-1de1-47a4-b01f-5d3ba46ae302" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-dada7b19-1de1-47a4-b01f-5d3ba46ae302" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:26 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a521998-ea41-429d-8960-c677ae57d988]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:26 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 Jul 24 15:57:26 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:27 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:27 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302 Jul 24 15:57:27 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:27 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-dada7b19-1de1-47a4-b01f-5d3ba46ae302" returned: 0 in 0.241s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-dada7b19-1de1-47a4-b01f-5d3ba46ae302" released by "delete_volume" :: held 0.627s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Created reservations ['fc38c463-a0b8-448d-bf9d-d915d1f87dec', 'e77fdca8-b099-4d10-ae9a-a24141948db6', 'd6cc4ad7-0ea5-4510-a7da-22a1299cfe2b', '88c2955c-ca4e-4c04-94f3-baf44faa8073'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:27 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:27 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:27 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.243s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Deleted volume successfully. Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-08d207ab-7246-40bb-a6c7-0b3d57ab28ff tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-dada7b19-1de1-47a4-b01f-5d3ba46ae302-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-quobyte-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff" acquired by "delete_volume" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[28728d37-a1b0-4a9e-ba40-ef62e8241565]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:27 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff Jul 24 15:57:27 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:28 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff" returned: 0 in 0.351s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:28 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff Jul 24 15:57:28 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:28 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff" returned: 0 in 0.246s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff" released by "delete_volume" :: held 0.632s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Created reservations ['dfadbb8c-9691-47a6-ba56-0e650c626950', 'ae9eccc2-ad79-4ea1-8cbf-8fd48a5e7d6b', 'bdf9fdd1-3e66-49cf-90ee-bb68adb6c80e', 'dc305c7c-fff6-48ee-af4a-219baf51da74'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:28 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:28 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:28 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.246s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Deleted volume successfully. Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1a43d202-c3ca-4e49-872b-07454f10da59 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-a9e7bbbd-be16-44e4-9067-f0ea6ed3deff-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-9e243820-3f72-4a86-91e8-9bad96ad2879-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-9e243820-3f72-4a86-91e8-9bad96ad2879-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-quobyte-9e243820-3f72-4a86-91e8-9bad96ad2879" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-9e243820-3f72-4a86-91e8-9bad96ad2879" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf2618-deb0-40ac-b371-41513e77d14e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:29 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 Jul 24 15:57:29 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:29 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879" returned: 0 in 0.369s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:29 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879 Jul 24 15:57:29 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:29 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-9e243820-3f72-4a86-91e8-9bad96ad2879" returned: 0 in 0.239s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-9e243820-3f72-4a86-91e8-9bad96ad2879" released by "delete_volume" :: held 0.649s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Created reservations ['e53e2271-961d-4e5d-ad65-de6daec2d8d5', '3d51c7dd-33e3-4591-b979-4481ebe93549', '916219c5-df90-4770-bbdc-ce7821c1106c', '7e455546-300c-48a4-bf6c-8639da789265'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:29 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:29 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:30 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.247s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Deleted volume successfully. Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3dda3909-e048-4a51-950d-240624d32e07 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-9e243820-3f72-4a86-91e8-9bad96ad2879-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-quobyte-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3df617-0b2b-4eae-8614-a7d2dbe7ff10]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:30 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e Jul 24 15:57:30 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:30 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e" returned: 0 in 0.360s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:30 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e Jul 24 15:57:30 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:30 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e" returned: 0 in 0.243s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e" released by "delete_volume" :: held 0.642s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Created reservations ['97c0a752-ce49-4f6c-ae8c-615bc514b318', 'bda6a6e3-730d-44f7-8f10-2d73b2cb9cd7', 'fd33e375-5696-47fa-b1c1-c03670b147b9', '291d558c-6329-4fe8-8a91-8d04516eeda8'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:30 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:30 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:31 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.280s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Deleted volume successfully. Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-fc6c34a7-69da-48e8-aeab-7fd0a077b184 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-13e1e49e-b9bf-4ac3-93bd-e18e524a1c0e-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-0b9c1486-8f0b-4c28-9178-e2808b3a92fa-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-0b9c1486-8f0b-4c28-9178-e2808b3a92fa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "cinder-quobyte-0b9c1486-8f0b-4c28-9178-e2808b3a92fa" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-0b9c1486-8f0b-4c28-9178-e2808b3a92fa" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d53a15-f711-4820-8888-db0fc3d2011e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:31 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa Jul 24 15:57:31 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:31 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa" returned: 0 in 0.375s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:31 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa Jul 24 15:57:31 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:32 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0b9c1486-8f0b-4c28-9178-e2808b3a92fa" returned: 0 in 0.266s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-quobyte-0b9c1486-8f0b-4c28-9178-e2808b3a92fa" released by "delete_volume" :: held 0.683s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Created reservations ['2425ec3b-14c5-4ca4-b910-5f10c409d228', '2f784d49-c1e2-4bc7-8e07-6816a42563f0', '29d04194-80cb-40a4-ab44-519d79082be7', 'e889f90b-2bf0-4ca9-b398-b5cbaf77aba6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:32 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:32 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:32 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.304s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Deleted volume successfully. Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-3438d444-e5d8-48a1-b836-ee1a98efc857 tempest-CreateVolumesFromImageTest-1542799502 None] Lock "cinder-0b9c1486-8f0b-4c28-9178-e2808b3a92fa-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-d4655fd6-b753-41b3-9c39-9298b6cfbe5c req-f79aec62-7de4-4140-89de-074f5243ebdb tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-d4655fd6-b753-41b3-9c39-9298b6cfbe5c req-f79aec62-7de4-4140-89de-074f5243ebdb tempest-TestStampPattern-582885974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4d9a21-d27a-405e-a3ff-bdd8c2d1e83e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-d4655fd6-b753-41b3-9c39-9298b6cfbe5c req-f79aec62-7de4-4140-89de-074f5243ebdb tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:32 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 Jul 24 15:57:32 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:33 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [req-d4655fd6-b753-41b3-9c39-9298b6cfbe5c req-f79aec62-7de4-4140-89de-074f5243ebdb tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98" returned: 0 in 0.368s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [req-d4655fd6-b753-41b3-9c39-9298b6cfbe5c req-f79aec62-7de4-4140-89de-074f5243ebdb tempest-TestStampPattern-582885974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.403s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-d4655fd6-b753-41b3-9c39-9298b6cfbe5c req-f79aec62-7de4-4140-89de-074f5243ebdb tempest-TestStampPattern-582885974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540', 'name': 'volume-129beb2f-cc2f-450d-87af-91d47a4f0d98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '209d6669-f1e3-4732-9257-5428918da8db', 'enforce_multipath': True} {{(pid=88251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:57:33 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-d4655fd6-b753-41b3-9c39-9298b6cfbe5c req-f79aec62-7de4-4140-89de-074f5243ebdb tempest-TestStampPattern-582885974 None] attachment_update completed successfully. Jul 24 15:57:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:57:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:34 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:34 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:35 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.253s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:57:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:57:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:57:36 devstack cinder-volume[88251]: INFO cinder.volume.manager [req-c6cf0f35-d52a-49d6-90e5-773aa3fecc08 req-a665d38f-3505-499f-903b-25442eac863a tempest-TestStampPattern-582885974 None] Terminate volume connection completed successfully. Jul 24 15:57:36 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [req-c6cf0f35-d52a-49d6-90e5-773aa3fecc08 req-a665d38f-3505-499f-903b-25442eac863a tempest-TestStampPattern-582885974 None] Deleting attachment 209d6669-f1e3-4732-9257-5428918da8db. {{(pid=88251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:57:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-129beb2f-cc2f-450d-87af-91d47a4f0d98-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Lock "cinder-129beb2f-cc2f-450d-87af-91d47a4f0d98-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-quobyte-129beb2f-cc2f-450d-87af-91d47a4f0d98" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-129beb2f-cc2f-450d-87af-91d47a4f0d98" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:40 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8bf20a-81af-4e0d-bafe-98b32f68311c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:40 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 Jul 24 15:57:40 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:40 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98" returned: 0 in 0.373s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:40 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98 Jul 24 15:57:40 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:41 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-129beb2f-cc2f-450d-87af-91d47a4f0d98" returned: 0 in 0.261s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-129beb2f-cc2f-450d-87af-91d47a4f0d98" released by "delete_volume" :: held 0.676s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Created reservations ['ae991e73-4a55-41ad-a541-5f7a99c0be95', 'f112165f-7777-43d9-9327-07b7a10d4e68', 'e7c9dae1-aebc-4389-86d8-695973953533', '55203d1e-3378-4391-ba64-4e2c2df3b3a1'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:41 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:41 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Flow 'volume_create_manager' (45bdd5fd-83d7-4d34-8357-89cf3c86358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c50798-0f22-4f7b-8465-0c561e1769ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c50798-0f22-4f7b-8465-0c561e1769ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-7289559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51a65cb-9a3d-4867-8966-07a452aa8dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83db48fb9e2e43629e41742d12efd07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:41Z,use_quota=True,user_id='28cd0c63113848f7b3236d7b2e4ea90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2775873-e291-4817-8411-0f4795fbdef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2775873-e291-4817-8411-0f4795fbdef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5023fa56-349e-48eb-95e6-cdc57eb1d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5023fa56-349e-48eb-95e6-cdc57eb1d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51a65cb-9a3d-4867-8966-07a452aa8dc6', 'volume_name': 'volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0465cfd1-78d3-4e74-8fa3-309dfd9b52e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0465cfd1-78d3-4e74-8fa3-309dfd9b52e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae25289-8d30-4600-8a5b-0447f9fc5749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Volume d51a65cb-9a3d-4867-8966-07a452aa8dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6', 'volume_size': 1} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-7289559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51a65cb-9a3d-4867-8966-07a452aa8dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83db48fb9e2e43629e41742d12efd07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:41Z,use_quota=True,user_id='28cd0c63113848f7b3236d7b2e4ea90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Creating volume d51a65cb-9a3d-4867-8966-07a452aa8dc6 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:41 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:41 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 1073741824 Jul 24 15:57:41 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:41 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Deleted volume successfully. Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2550e2c-e303-4dbb-ad29-c8c721e4e226 tempest-TestStampPattern-582885974 None] Lock "cinder-129beb2f-cc2f-450d-87af-91d47a4f0d98-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:41 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 1073741824" returned: 0 in 0.498s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-c2ec8e5a-a4d0-4736-832d-92bcbef69976-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Lock "cinder-c2ec8e5a-a4d0-4736-832d-92bcbef69976-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-quobyte-6ff5805d-e914-44f1-a654-2c7d3f970705" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-6ff5805d-e914-44f1-a654-2c7d3f970705" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-quobyte-c2ec8e5a-a4d0-4736-832d-92bcbef69976" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:42 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 Jul 24 15:57:42 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-c2ec8e5a-a4d0-4736-832d-92bcbef69976" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Deleting offline snapshot c2ec8e5a-a4d0-4736-832d-92bcbef69976 of volume 6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] snapshot_file for this snap is: volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d248998-5037-48d1-948e-157131d869d7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:42 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 Jul 24 15:57:42 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:42 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6" returned: 0 in 0.258s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae25289-8d30-4600-8a5b-0447f9fc5749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700655d2-7fcb-44b1-88ce-268dd03a224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:42 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Volume volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 (d51a65cb-9a3d-4867-8966-07a452aa8dc6): created successfully Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700655d2-7fcb-44b1-88ce-268dd03a224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Flow 'volume_create_manager' (45bdd5fd-83d7-4d34-8357-89cf3c86358c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-10c89fc0-e5fc-447e-9d0a-275227f13867 tempest-ProjectReaderTests-1724725349 None] Created volume successfully. Jul 24 15:57:42 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976" returned: 0 in 0.354s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ff5805d-e914-44f1-a654-2c7d3f970705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2755e2-f6b3-419b-9517-73ae7bdbc9f9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:42 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 Jul 24 15:57:42 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:42 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705" returned: 0 in 0.344s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:42 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 Jul 24 15:57:42 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:43 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976" returned: 0 in 0.315s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:43 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976 Jul 24 15:57:43 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:43 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705.c2ec8e5a-a4d0-4736-832d-92bcbef69976" returned: 0 in 0.242s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-c2ec8e5a-a4d0-4736-832d-92bcbef69976" released by "_delete_snapshot" :: held 1.354s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-6ff5805d-e914-44f1-a654-2c7d3f970705" released by "delete_snapshot" :: held 1.376s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Created reservations ['3675d807-cd68-4428-8f0c-92bf3076c08d', '62808f7a-4418-43cd-ac01-cc087bd1ad55', '3b54a5fb-808a-49e9-bb8e-5a04e6ba9b86', '99e956c0-0f62-4f13-9ab9-19d83e54ba20'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:43 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Delete snapshot completed successfully. Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-9da603a8-5160-4dc4-9940-5212750128c1 tempest-TestStampPattern-582885974 None] Lock "cinder-c2ec8e5a-a4d0-4736-832d-92bcbef69976-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "cinder-d51a65cb-9a3d-4867-8966-07a452aa8dc6-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Lock "cinder-d51a65cb-9a3d-4867-8966-07a452aa8dc6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "cinder-quobyte-d51a65cb-9a3d-4867-8966-07a452aa8dc6" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Lock "cinder-quobyte-d51a65cb-9a3d-4867-8966-07a452aa8dc6" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[57594da8-cae6-4e31-9f51-7db9fba997bc]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:43 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 Jul 24 15:57:43 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:44 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6" returned: 0 in 0.364s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:44 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6 Jul 24 15:57:44 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:44 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-d51a65cb-9a3d-4867-8966-07a452aa8dc6" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Lock "cinder-quobyte-d51a65cb-9a3d-4867-8966-07a452aa8dc6" released by "delete_volume" :: held 0.657s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Created reservations ['8825f2de-da81-49ab-b056-55afc02db196', '3804d9cf-bbc3-4c66-b871-728d4101c624', '3f81ceef-176a-4310-9364-cdab51f01b0c', '0a213bcb-dbc6-4bfa-806b-2ecd61d4a96a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:44 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:44 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:44 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.275s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:44 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Deleted volume successfully. Jul 24 15:57:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-67c36212-6d67-496a-bcac-247cb0a15ab4 tempest-ProjectReaderTests-1724725349 None] Lock "cinder-d51a65cb-9a3d-4867-8966-07a452aa8dc6-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Flow 'volume_create_manager' (b3262702-c1b2-4768-8529-128c37fd19f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fb096c-b0d3-4a96-9f8f-d1fed97b958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fb096c-b0d3-4a96-9f8f-d1fed97b958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671612360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9b5704-8adf-441e-bf7b-733a1d22ade8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83db48fb9e2e43629e41742d12efd07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:45Z,use_quota=True,user_id='28cd0c63113848f7b3236d7b2e4ea90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5235f0-a750-46d0-8186-25c143ebe1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5235f0-a750-46d0-8186-25c143ebe1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eb1e37-cb1f-4c0a-aae5-3f6830fd1547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eb1e37-cb1f-4c0a-aae5-3f6830fd1547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c9b5704-8adf-441e-bf7b-733a1d22ade8', 'volume_name': 'volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6a81e6-b65e-4403-8673-75b9328db046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6a81e6-b65e-4403-8673-75b9328db046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a283d747-3c7f-4aaa-aa40-a6f2c423f7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:45 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Volume 2c9b5704-8adf-441e-bf7b-733a1d22ade8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8', 'volume_size': 1} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671612360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9b5704-8adf-441e-bf7b-733a1d22ade8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83db48fb9e2e43629e41742d12efd07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:45Z,use_quota=True,user_id='28cd0c63113848f7b3236d7b2e4ea90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Creating volume 2c9b5704-8adf-441e-bf7b-733a1d22ade8 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:45 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:45 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 1073741824 Jul 24 15:57:45 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:46 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 1073741824" returned: 0 in 0.582s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:46 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 Jul 24 15:57:46 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:46 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8" returned: 0 in 0.254s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a283d747-3c7f-4aaa-aa40-a6f2c423f7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b469ace9-f076-418e-aca1-57b0b4cc9d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:46 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Volume volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 (2c9b5704-8adf-441e-bf7b-733a1d22ade8): created successfully Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b469ace9-f076-418e-aca1-57b0b4cc9d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:46 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Flow 'volume_create_manager' (b3262702-c1b2-4768-8529-128c37fd19f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a30fc3f8-c2db-4201-916b-697711601338 tempest-ProjectReaderTests-1724725349 None] Created volume successfully. Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "cinder-2c9b5704-8adf-441e-bf7b-733a1d22ade8-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Lock "cinder-2c9b5704-8adf-441e-bf7b-733a1d22ade8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "cinder-quobyte-2c9b5704-8adf-441e-bf7b-733a1d22ade8" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Lock "cinder-quobyte-2c9b5704-8adf-441e-bf7b-733a1d22ade8" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83942b4-e360-4b1e-a28c-6b24cbd24589]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:47 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 Jul 24 15:57:47 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-6ff5805d-e914-44f1-a654-2c7d3f970705-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Lock "cinder-6ff5805d-e914-44f1-a654-2c7d3f970705-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Acquiring lock "cinder-quobyte-6ff5805d-e914-44f1-a654-2c7d3f970705" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-6ff5805d-e914-44f1-a654-2c7d3f970705" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3375bb10-15e8-46ef-9223-43c7769cff85]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:47 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8" returned: 0 in 0.397s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:47 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8 Jul 24 15:57:47 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:48 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 Jul 24 15:57:48 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:48 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2c9b5704-8adf-441e-bf7b-733a1d22ade8" returned: 0 in 0.279s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Lock "cinder-quobyte-2c9b5704-8adf-441e-bf7b-733a1d22ade8" released by "delete_volume" :: held 0.717s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Created reservations ['f6fea870-18f8-4248-ae87-1c140e732186', 'f4d5a6a3-b41c-4888-bbe6-63d1e52b5884', 'de91923a-4d66-46f3-85af-9414dfa61eab', 'a11c69cb-39d2-4c67-afa2-d1b59529187a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:48 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705" returned: 0 in 0.378s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:48 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705 Jul 24 15:57:48 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:48 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:48 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:48 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-6ff5805d-e914-44f1-a654-2c7d3f970705" returned: 0 in 0.265s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Lock "cinder-quobyte-6ff5805d-e914-44f1-a654-2c7d3f970705" released by "delete_volume" :: held 0.707s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:48 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.253s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Deleted volume successfully. Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92dbfe62-f7c5-4e12-89c0-a47f62c84342 tempest-ProjectReaderTests-1724725349 None] Lock "cinder-2c9b5704-8adf-441e-bf7b-733a1d22ade8-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Created reservations ['f5b25335-0920-422b-8ac6-4b17c4025270', 'eb1f5765-c74f-4ce5-b7a6-68117b3be811', 'e3335bd7-ac09-4661-82aa-48c1b6868626', 'b11e40e4-1ac4-4c08-a500-abd14614fabd'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:48 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:48 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:49 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.275s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Deleted volume successfully. Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f7753905-b602-4d75-9365-950ee4e058cd tempest-TestStampPattern-582885974 None] Lock "cinder-6ff5805d-e914-44f1-a654-2c7d3f970705-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Flow 'volume_create_manager' (0438f93e-4bab-406b-a047-a362473023db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcdfbcfd-9321-482c-865a-510259252efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcdfbcfd-9321-482c-865a-510259252efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103509265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d90b69-0d29-4cc1-837a-ff7db2655b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83db48fb9e2e43629e41742d12efd07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:49Z,use_quota=True,user_id='28cd0c63113848f7b3236d7b2e4ea90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537a27f1-d896-4ca3-b54e-8f48e7ab8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537a27f1-d896-4ca3-b54e-8f48e7ab8375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d138db-fbd7-4232-8f63-1fb7f2b1b7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d138db-fbd7-4232-8f63-1fb7f2b1b7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d90b69-0d29-4cc1-837a-ff7db2655b87', 'volume_name': 'volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68da0db-13ef-4093-b0a9-f0f431d895be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68da0db-13ef-4093-b0a9-f0f431d895be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4db5ac-b197-48d7-b375-e0382a7fb6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Volume b9d90b69-0d29-4cc1-837a-ff7db2655b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87', 'volume_size': 1} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103509265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d90b69-0d29-4cc1-837a-ff7db2655b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83db48fb9e2e43629e41742d12efd07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:49Z,use_quota=True,user_id='28cd0c63113848f7b3236d7b2e4ea90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Creating volume b9d90b69-0d29-4cc1-837a-ff7db2655b87 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:49 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:49 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 1073741824 Jul 24 15:57:49 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:49 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 1073741824" returned: 0 in 0.434s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:49 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 Jul 24 15:57:49 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:49 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87" returned: 0 in 0.256s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4db5ac-b197-48d7-b375-e0382a7fb6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8330713-6caa-4ecc-863e-1c3b1649ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Volume volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 (b9d90b69-0d29-4cc1-837a-ff7db2655b87): created successfully Jul 24 15:57:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8330713-6caa-4ecc-863e-1c3b1649ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Flow 'volume_create_manager' (0438f93e-4bab-406b-a047-a362473023db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3c132e0c-ae06-4fb1-8c24-597b29d9b721 tempest-ProjectReaderTests-1724725349 None] Created volume successfully. Jul 24 15:57:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Acquiring lock "cinder-b9d90b69-0d29-4cc1-837a-ff7db2655b87-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Lock "cinder-b9d90b69-0d29-4cc1-837a-ff7db2655b87-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Acquiring lock "cinder-quobyte-b9d90b69-0d29-4cc1-837a-ff7db2655b87" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:51 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Lock "cinder-quobyte-b9d90b69-0d29-4cc1-837a-ff7db2655b87" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:51 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce6b4ed-3446-488d-a188-7a07c8e8fdca]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:51 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 Jul 24 15:57:51 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:51 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87" returned: 0 in 0.396s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:51 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87 Jul 24 15:57:51 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:52 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b9d90b69-0d29-4cc1-837a-ff7db2655b87" returned: 0 in 0.265s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Lock "cinder-quobyte-b9d90b69-0d29-4cc1-837a-ff7db2655b87" released by "delete_volume" :: held 0.720s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Created reservations ['ac8f99ba-d9da-4bde-8c44-5a12b7d1da82', 'f06afadb-a80c-4983-a2dd-bf560044cd01', 'a9a9f9de-216a-44e5-b380-1c494e427043', '3ff30947-9e34-4dc1-9a7c-ad18b0acdcbc'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:52 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:52 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:52 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.278s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Deleted volume successfully. Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-64ec24b6-7881-40cb-ac51-c713ba38ca8c tempest-ProjectReaderTests-1724725349 None] Lock "cinder-b9d90b69-0d29-4cc1-837a-ff7db2655b87-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Flow 'volume_create_manager' (27b0d913-6781-4e71-87df-f4ca27806bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50e52d6-046b-495b-acf3-429b739bafb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50e52d6-046b-495b-acf3-429b739bafb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511884349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacf6946-c4d5-45ac-8e97-f4604d433b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83db48fb9e2e43629e41742d12efd07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:53Z,use_quota=True,user_id='28cd0c63113848f7b3236d7b2e4ea90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2f44e4-8d80-497a-92ac-e746f99950b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2f44e4-8d80-497a-92ac-e746f99950b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b606935b-f013-480a-876f-f6f390a1df6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b606935b-f013-480a-876f-f6f390a1df6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cacf6946-c4d5-45ac-8e97-f4604d433b35', 'volume_name': 'volume-cacf6946-c4d5-45ac-8e97-f4604d433b35', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96590f96-e55f-4fd2-818b-90e097ff5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96590f96-e55f-4fd2-818b-90e097ff5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e3569f-c62a-4b94-b039-98fa4e132f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:53 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Volume cacf6946-c4d5-45ac-8e97-f4604d433b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cacf6946-c4d5-45ac-8e97-f4604d433b35', 'volume_size': 1} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511884349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacf6946-c4d5-45ac-8e97-f4604d433b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83db48fb9e2e43629e41742d12efd07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:53Z,use_quota=True,user_id='28cd0c63113848f7b3236d7b2e4ea90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Creating volume cacf6946-c4d5-45ac-8e97-f4604d433b35 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:53 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:53 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 1073741824 Jul 24 15:57:53 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:53 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 1073741824" returned: 0 in 0.456s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:53 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 Jul 24 15:57:53 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:53 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35" returned: 0 in 0.271s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e3569f-c62a-4b94-b039-98fa4e132f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cacf6946-c4d5-45ac-8e97-f4604d433b35', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f170ed-b1fc-44ec-ae4a-d34b4f812e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:53 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Volume volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 (cacf6946-c4d5-45ac-8e97-f4604d433b35): created successfully Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f170ed-b1fc-44ec-ae4a-d34b4f812e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:53 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Flow 'volume_create_manager' (27b0d913-6781-4e71-87df-f4ca27806bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:53 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d50982d9-16e4-408e-8117-ab16a2f33b9d tempest-ProjectReaderTests-1724725349 None] Created volume successfully. Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Acquiring lock "cinder-cacf6946-c4d5-45ac-8e97-f4604d433b35-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Lock "cinder-cacf6946-c4d5-45ac-8e97-f4604d433b35-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Acquiring lock "cinder-quobyte-cacf6946-c4d5-45ac-8e97-f4604d433b35" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Lock "cinder-quobyte-cacf6946-c4d5-45ac-8e97-f4604d433b35" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e9ae9-f00f-4bfb-83a4-cab6f0a593c4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:55 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 Jul 24 15:57:55 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:55 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35" returned: 0 in 0.401s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:55 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35 Jul 24 15:57:55 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:55 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cacf6946-c4d5-45ac-8e97-f4604d433b35" returned: 0 in 0.276s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Lock "cinder-quobyte-cacf6946-c4d5-45ac-8e97-f4604d433b35" released by "delete_volume" :: held 0.729s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:55 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Created reservations ['f22440dc-6578-4c04-9562-e3c30bf90a59', '1b5063e4-8d42-4ae0-a1e5-2d5b6700e647', '363ddc6a-e1b0-41ea-a1f4-eeee45a7ae32', 'd4ccf142-cb8d-435b-9cb4-9d72dbda9bb8'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:56 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:57:56 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:56 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.287s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Deleted volume successfully. Jul 24 15:57:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5795e9a6-9f5a-45a8-966e-d427f04dec8e tempest-ProjectReaderTests-1724725349 None] Lock "cinder-cacf6946-c4d5-45ac-8e97-f4604d433b35-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:06 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=83,cinder:UPDATE=138,cinder:DELETE=12,cinder:INSERT=29 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:58:06 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=96,cinder:UPDATE=115,cinder:INSERT=28,cinder:DELETE=8 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Flow 'volume_create_manager' (9556e1be-6841-4fb5-bd0d-ff9c71da22ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde0c913-d6b3-4297-9dba-902d2e38b616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde0c913-d6b3-4297-9dba-902d2e38b616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-223074483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04138bfd-ce6c-4965-91e1-c2d4a7ba18dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0e4af2ecf04268af465d16a50bc3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:58:26Z,use_quota=True,user_id='758e6778f99d433fb8aab761b3564bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57389195-a6ae-4ce1-821b-4d862bf68ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57389195-a6ae-4ce1-821b-4d862bf68ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80977d8-498a-4e6c-a522-3c11c24168cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80977d8-498a-4e6c-a522-3c11c24168cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04138bfd-ce6c-4965-91e1-c2d4a7ba18dc', 'volume_name': 'volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d193714-e24e-451d-bb00-07dc73391c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d193714-e24e-451d-bb00-07dc73391c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc27298-5b35-4d9d-9b4b-2d1ec5f75ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Volume 04138bfd-ce6c-4965-91e1-c2d4a7ba18dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc', 'volume_size': 1} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-223074483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04138bfd-ce6c-4965-91e1-c2d4a7ba18dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0e4af2ecf04268af465d16a50bc3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:58:26Z,use_quota=True,user_id='758e6778f99d433fb8aab761b3564bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Creating volume 04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:58:26 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:26 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc 1073741824 Jul 24 15:58:26 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:26 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc 1073741824" returned: 0 in 0.399s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:26 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc Jul 24 15:58:26 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:26 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" returned: 0 in 0.244s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc27298-5b35-4d9d-9b4b-2d1ec5f75ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac39f8c3-b340-45f9-b38d-b850a0b73515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Volume volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc (04138bfd-ce6c-4965-91e1-c2d4a7ba18dc): created successfully Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac39f8c3-b340-45f9-b38d-b850a0b73515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Flow 'volume_create_manager' (9556e1be-6841-4fb5-bd0d-ff9c71da22ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d4e07727-9b46-4c30-b93b-82323e81ab52 tempest-SnapshotDependencyTests-386326801 None] Created volume successfully. Jul 24 15:58:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Creating offline snapshot 85166ac8-641e-490b-b20a-e9b458bf7204 of volume 04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:58:27 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8d1e41-e905-4b80-8d00-6a9f0303f1e3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:27 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc Jul 24 15:58:27 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:27 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" returned: 0 in 0.350s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:27 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 1G Jul 24 15:58:27 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:28 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 1G" returned: 0 in 0.408s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:28 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 Jul 24 15:58:28 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:28 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204" returned: 0 in 0.281s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:28 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 is being set with open permissions: ugo+rw Jul 24 15:58:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:28 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 Jul 24 15:58:28 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:28 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204" returned: 0 in 0.234s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:28 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.info Jul 24 15:58:28 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:28 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.info" returned: 0 in 0.249s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:28 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.info is being set with open permissions: ugo+rw Jul 24 15:58:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:28 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.info Jul 24 15:58:28 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:29 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.info" returned: 0 in 0.249s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-da6cf7f7-cdb0-4835-8d2f-67714f155040 tempest-SnapshotDependencyTests-386326801 None] Create snapshot completed successfully Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Flow 'volume_create_manager' (ca216edd-e838-4adb-8430-376f8f0bdc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9801ad7c-ac01-4187-91f7-0c96f6109b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9801ad7c-ac01-4187-91f7-0c96f6109b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a2e005-53b5-4e15-9182-40e5c2b21abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0e4af2ecf04268af465d16a50bc3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=85166ac8-641e-490b-b20a-e9b458bf7204,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:58:30Z,use_quota=True,user_id='758e6778f99d433fb8aab761b3564bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ae4c71-b4db-4a9a-aeb1-460c4fdab6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ae4c71-b4db-4a9a-aeb1-460c4fdab6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513c9b3b-f8cb-4193-bce2-d5bc234107bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513c9b3b-f8cb-4193-bce2-d5bc234107bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0a2e005-53b5-4e15-9182-40e5c2b21abf', 'volume_name': 'volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf', 'volume_size': 1, 'snapshot_id': '85166ac8-641e-490b-b20a-e9b458bf7204'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60aa785-4962-4faa-becf-3a46c1cc34bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60aa785-4962-4faa-becf-3a46c1cc34bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b5d757-f787-401c-bd74-e64148eb0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:30 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Volume c0a2e005-53b5-4e15-9182-40e5c2b21abf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf', 'volume_size': 1, 'snapshot_id': '85166ac8-641e-490b-b20a-e9b458bf7204'} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-quobyte-85166ac8-641e-490b-b20a-e9b458bf7204-c0a2e005-53b5-4e15-9182-40e5c2b21abf" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-85166ac8-641e-490b-b20a-e9b458bf7204-c0a2e005-53b5-4e15-9182-40e5c2b21abf" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Creating volume c0a2e005-53b5-4e15-9182-40e5c2b21abf from snapshot 85166ac8-641e-490b-b20a-e9b458bf7204 {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-quobyte-c0a2e005-53b5-4e15-9182-40e5c2b21abf" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-c0a2e005-53b5-4e15-9182-40e5c2b21abf" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] snapshot: 85166ac8-641e-490b-b20a-e9b458bf7204, volume: c0a2e005-53b5-4e15-9182-40e5c2b21abf, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84a1771-27e7-45b3-82f3-e0ace19eb418]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:30 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 Jul 24 15:58:30 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:30 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0960b839-7d0a-4d92-a1c1-ca0774f32077]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:30 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc Jul 24 15:58:30 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:30 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:58:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:30 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf Jul 24 15:58:30 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:34 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:58:34 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:34 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf" returned: 0 in 4.099s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9d8e8f-8f6d-41c1-8d67-340dd5241ff4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:35 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc Jul 24 15:58:35 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:35 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.314s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:58:35 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" returned: 0 in 0.549s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc, size 1024.00 MB, duration 4.10 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:58:35 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Converted 1024.00 MB image at 249.71 MB/s Jul 24 15:58:35 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf is being set with open permissions: ugo+rw Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:35 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf Jul 24 15:58:35 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:35 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf" returned: 0 in 0.247s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-c0a2e005-53b5-4e15-9182-40e5c2b21abf" released by "_copy_volume_from_snapshot" :: held 5.697s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-85166ac8-641e-490b-b20a-e9b458bf7204-c0a2e005-53b5-4e15-9182-40e5c2b21abf" released by "_create_volume_from_snapshot" :: held 5.729s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.743s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b5d757-f787-401c-bd74-e64148eb0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf', 'volume_size': 1, 'snapshot_id': '85166ac8-641e-490b-b20a-e9b458bf7204'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97416c04-52b3-43d2-9085-76760b890af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:35 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Volume volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf (c0a2e005-53b5-4e15-9182-40e5c2b21abf): created successfully Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97416c04-52b3-43d2-9085-76760b890af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Flow 'volume_create_manager' (ca216edd-e838-4adb-8430-376f8f0bdc62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-11acf833-26f2-4665-87a9-c41a45d780a4 tempest-SnapshotDependencyTests-386326801 None] Created volume successfully. Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-85166ac8-641e-490b-b20a-e9b458bf7204-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-85166ac8-641e-490b-b20a-e9b458bf7204-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-quobyte-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-quobyte-85166ac8-641e-490b-b20a-e9b458bf7204" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-85166ac8-641e-490b-b20a-e9b458bf7204" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Deleting offline snapshot 85166ac8-641e-490b-b20a-e9b458bf7204 of volume 04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] snapshot_file for this snap is: volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ac26d-f98c-44ef-b9d3-88801e6ad42e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:36 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 Jul 24 15:58:36 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:36 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204" returned: 0 in 0.357s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:58:37 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9937996f-6a2d-47ec-8483-9acfb612ec09]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:37 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc Jul 24 15:58:37 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:37 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" returned: 0 in 0.366s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:37 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 Jul 24 15:58:37 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:37 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204" returned: 0 in 0.334s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:37 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204 Jul 24 15:58:37 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:37 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc.85166ac8-641e-490b-b20a-e9b458bf7204" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-85166ac8-641e-490b-b20a-e9b458bf7204" released by "_delete_snapshot" :: held 1.410s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" released by "delete_snapshot" :: held 1.434s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Created reservations ['e552f945-56b1-4bb1-89ce-e347877e12f2', '6a451c6e-9cae-4485-85e9-8074a23ad101', 'd70db92a-1d9e-46c5-8b5e-3e8b439dd782', 'f9d602bd-7562-459b-90c7-b1b9bf478a59'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:38 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Delete snapshot completed successfully. Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cf0d65d0-f1f3-4681-bca5-8d648bac8edb tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-85166ac8-641e-490b-b20a-e9b458bf7204-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-quobyte-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[77462552-9f37-41ac-84f8-e452020a174d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:38 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc Jul 24 15:58:38 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:39 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" returned: 0 in 0.372s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:39 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc Jul 24 15:58:39 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:39 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" returned: 0 in 0.245s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc" released by "delete_volume" :: held 0.676s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Created reservations ['1862dcef-f384-4207-b73f-9bc762ac4b80', '53822645-4e6b-4f5b-9dd0-62b5383de6f2', '1a9c5f67-2ec7-4d0d-9d32-56775c5bb3b0', 'b3307493-553f-48d8-af45-9d1e35751198'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:39 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:58:39 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:39 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.244s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:39 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Deleted volume successfully. Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-eedc288e-9d60-4bdf-82f1-f2b653ea7b9c tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-04138bfd-ce6c-4965-91e1-c2d4a7ba18dc-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-c0a2e005-53b5-4e15-9182-40e5c2b21abf-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-c0a2e005-53b5-4e15-9182-40e5c2b21abf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "cinder-quobyte-c0a2e005-53b5-4e15-9182-40e5c2b21abf" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-c0a2e005-53b5-4e15-9182-40e5c2b21abf" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07c78e7-732a-41a6-9afa-4be932d05942]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:40 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf Jul 24 15:58:40 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:40 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf" returned: 0 in 0.369s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:40 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf Jul 24 15:58:40 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:40 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c0a2e005-53b5-4e15-9182-40e5c2b21abf" returned: 0 in 0.245s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-quobyte-c0a2e005-53b5-4e15-9182-40e5c2b21abf" released by "delete_volume" :: held 0.659s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Created reservations ['e83e1fdf-55eb-49a8-a7bc-fb1449b3383e', '2d3beee0-5472-4d46-a284-3f389fc22d5e', '05dd749e-748d-4ed7-a3d2-931b6a4f7cea', '45bae3b7-c3b0-4927-8f74-339855886724'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:40 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:58:40 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:40 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.264s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:40 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:40 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Deleted volume successfully. Jul 24 15:58:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-bc38e70e-bc76-411a-a13b-56d1f7ee0ace tempest-SnapshotDependencyTests-386326801 None] Lock "cinder-c0a2e005-53b5-4e15-9182-40e5c2b21abf-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:50 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=29,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:58:51 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=18,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:58:59 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (98edaf63-ecae-4eb0-8e8e-fd58abe385ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653362bd-c5aa-4a7b-b6e4-2d51ae5f6964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653362bd-c5aa-4a7b-b6e4-2d51ae5f6964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1846086818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb276e0-13f8-4f60-95aa-cce36c71b004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:00Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22c64bc-4e40-40b9-96e2-2dc85c41015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22c64bc-4e40-40b9-96e2-2dc85c41015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f089da-536a-49a4-9ef3-5d7225a5f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f089da-536a-49a4-9ef3-5d7225a5f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb276e0-13f8-4f60-95aa-cce36c71b004', 'volume_name': 'volume-cdb276e0-13f8-4f60-95aa-cce36c71b004', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0014c86-ca53-4f32-b5ac-733a80ca0e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0014c86-ca53-4f32-b5ac-733a80ca0e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa1d55b-6a84-4491-b968-66aedf9cd62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Volume cdb276e0-13f8-4f60-95aa-cce36c71b004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb276e0-13f8-4f60-95aa-cce36c71b004', 'volume_size': 1} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1846086818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb276e0-13f8-4f60-95aa-cce36c71b004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:00Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Creating volume cdb276e0-13f8-4f60-95aa-cce36c71b004 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:00 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:00 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 1073741824 Jul 24 15:59:00 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (14bdf901-5443-4545-8e74-c916b073591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be7f405-7f03-43f9-8dd1-d233c274839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be7f405-7f03-43f9-8dd1-d233c274839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64833539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2f6a5a-0b99-42d3-8c0f-5d444ac47822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:00Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:00 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663ad777-f344-4771-8932-c051646e89fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663ad777-f344-4771-8932-c051646e89fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5535b8e4-0b24-47f3-99f4-e492f030dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5535b8e4-0b24-47f3-99f4-e492f030dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2f6a5a-0b99-42d3-8c0f-5d444ac47822', 'volume_name': 'volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cd542e-0865-492f-932d-03b4b77e09cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cd542e-0865-492f-932d-03b4b77e09cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49dc4e69-10b2-4526-8084-9c2b2f34b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:00 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume eb2f6a5a-0b99-42d3-8c0f-5d444ac47822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822', 'volume_size': 1} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 1073741824" returned: 0 in 0.771s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (ff91910e-d61e-4fb4-9e45-e4dc29876886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bd15e0-e92f-4455-97a7-ade35d665da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bd15e0-e92f-4455-97a7-ade35d665da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24796041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5400df6a-ab3a-43a4-814c-abea34c063d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:01Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5901ac08-2054-445c-94b4-7563b70f2b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5901ac08-2054-445c-94b4-7563b70f2b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb82d789-09f5-4fcc-b61f-f2247d55ab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb82d789-09f5-4fcc-b61f-f2247d55ab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5400df6a-ab3a-43a4-814c-abea34c063d5', 'volume_name': 'volume-5400df6a-ab3a-43a4-814c-abea34c063d5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f3f06f-e328-48f0-a4b9-1d05f5d581f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f3f06f-e328-48f0-a4b9-1d05f5d581f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400a0dcc-d2f5-43bf-be30-c0dc1f8dcf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Volume 5400df6a-ab3a-43a4-814c-abea34c063d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5400df6a-ab3a-43a4-814c-abea34c063d5', 'volume_size': 1} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:01 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 Jul 24 15:59:01 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (0ffd8326-8f91-4184-b62e-5dbefe0a134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee085cd-eb91-42a3-962e-f29fa1b576f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee085cd-eb91-42a3-962e-f29fa1b576f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1255954876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fef836-9c17-4777-bd35-76f9d44913f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:01Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98149267-d69e-4da6-a404-150c6888c829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98149267-d69e-4da6-a404-150c6888c829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92b74dc-97f1-4ed0-9c43-ffa5da4f5c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92b74dc-97f1-4ed0-9c43-ffa5da4f5c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62fef836-9c17-4777-bd35-76f9d44913f1', 'volume_name': 'volume-62fef836-9c17-4777-bd35-76f9d44913f1', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4eba392-304e-4211-996c-849d1b7c9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4eba392-304e-4211-996c-849d1b7c9581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3e6ab3-c03c-415b-b0db-67a79098b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Volume 62fef836-9c17-4777-bd35-76f9d44913f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62fef836-9c17-4777-bd35-76f9d44913f1', 'volume_size': 1} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (fd328431-2396-4d78-98ad-4f39efc1df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07276ad-a06f-4add-9161-4894cccf6959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07276ad-a06f-4add-9161-4894cccf6959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-67769598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c771244-f986-4886-ac15-6d27d2ff3be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:02Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ec6f67-ddca-4ccc-b28b-dd2ff1491ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ec6f67-ddca-4ccc-b28b-dd2ff1491ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803e292e-7e60-4b54-af0e-cce053621e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803e292e-7e60-4b54-af0e-cce053621e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c771244-f986-4886-ac15-6d27d2ff3be7', 'volume_name': 'volume-5c771244-f986-4886-ac15-6d27d2ff3be7', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871d5e6c-5108-44c1-9dca-dc258729fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871d5e6c-5108-44c1-9dca-dc258729fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0f992b-5af0-436f-90c5-ea2e5c0cf1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Volume 5c771244-f986-4886-ac15-6d27d2ff3be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c771244-f986-4886-ac15-6d27d2ff3be7', 'volume_size': 1} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004" returned: 0 in 0.580s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64833539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2f6a5a-0b99-42d3-8c0f-5d444ac47822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:00Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Creating volume eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:01 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa1d55b-6a84-4491-b968-66aedf9cd62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb276e0-13f8-4f60-95aa-cce36c71b004', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 1073741824 Jul 24 15:59:01 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd6c060-134a-4f54-97b2-d68ab249cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:01 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Volume volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 (cdb276e0-13f8-4f60-95aa-cce36c71b004): created successfully Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd6c060-134a-4f54-97b2-d68ab249cd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:01 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (98edaf63-ecae-4eb0-8e8e-fd58abe385ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-02e64057-a487-4556-b1e6-1c1553edbbd3 tempest-CreateVolumesFromImageTest-1202335600 None] Created volume successfully. Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (20116fab-d781-46c5-96ae-222647cd7261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d92014-8620-4699-92fe-0005fa48fb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d92014-8620-4699-92fe-0005fa48fb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-57923845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff2ec3-21de-4c71-b72f-56ac7760a536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:02Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b51fe86-9f41-4fa7-ad73-21d9b20c5420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b51fe86-9f41-4fa7-ad73-21d9b20c5420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2358532e-3b20-41a6-88f9-a6a09442d680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2358532e-3b20-41a6-88f9-a6a09442d680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ff2ec3-21de-4c71-b72f-56ac7760a536', 'volume_name': 'volume-37ff2ec3-21de-4c71-b72f-56ac7760a536', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3871347-ccb2-479c-b57a-8fc655a0d5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3871347-ccb2-479c-b57a-8fc655a0d5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6c3c4c-532c-4de0-b31b-d70da6fb83f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:02 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Volume 37ff2ec3-21de-4c71-b72f-56ac7760a536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ff2ec3-21de-4c71-b72f-56ac7760a536', 'volume_size': 1} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:02 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 1073741824" returned: 0 in 0.629s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:02 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 Jul 24 15:59:02 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:02 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" returned: 0 in 0.305s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24796041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5400df6a-ab3a-43a4-814c-abea34c063d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:01Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Creating volume 5400df6a-ab3a-43a4-814c-abea34c063d5 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:02 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49dc4e69-10b2-4526-8084-9c2b2f34b84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:02 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 1073741824 Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deda1296-434c-4884-b0fc-82e83fe7fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:02 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:02 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 (eb2f6a5a-0b99-42d3-8c0f-5d444ac47822): created successfully Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deda1296-434c-4884-b0fc-82e83fe7fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (14bdf901-5443-4545-8e74-c916b073591e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:02 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-db045295-d00d-41be-bb58-3c200e76c464 tempest-CreateVolumesFromSnapshotTest-20958585 None] Created volume successfully. Jul 24 15:59:03 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 1073741824" returned: 0 in 0.516s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:03 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 Jul 24 15:59:03 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:03 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.283s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1255954876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fef836-9c17-4777-bd35-76f9d44913f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:01Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Creating volume 62fef836-9c17-4777-bd35-76f9d44913f1 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:03 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:03 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 1073741824 Jul 24 15:59:03 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400a0dcc-d2f5-43bf-be30-c0dc1f8dcf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5400df6a-ab3a-43a4-814c-abea34c063d5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8400e0c0-b4af-4fea-b3ff-188dc353fb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:03 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Volume volume-5400df6a-ab3a-43a4-814c-abea34c063d5 (5400df6a-ab3a-43a4-814c-abea34c063d5): created successfully Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8400e0c0-b4af-4fea-b3ff-188dc353fb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (ff91910e-d61e-4fb4-9e45-e4dc29876886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:03 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-476f31ff-d993-4cb5-963e-cc561a5f2fb3 tempest-CreateVolumesFromImageTest-1202335600 None] Created volume successfully. Jul 24 15:59:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Flow 'volume_create_manager' (a5fb97bc-454d-4180-ae16-df2eda28ad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1904b308-e914-4a17-942b-2484d8129aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1904b308-e914-4a17-942b-2484d8129aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b7eedc-661a-44a1-8329-23b65e8410b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f30e8d92bb44e10b19a207974c2483c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:04Z,use_quota=True,user_id='79d2fee6cf0745bf8a29928f99b2e8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac0e787-820d-43a7-8cee-6365997d66b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac0e787-820d-43a7-8cee-6365997d66b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfe719c-77b3-4118-a2c8-5434a9eb24d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:59:04 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 1073741824" returned: 0 in 0.651s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:04 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 Jul 24 15:59:04 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfe719c-77b3-4118-a2c8-5434a9eb24d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50b7eedc-661a-44a1-8329-23b65e8410b9', 'volume_name': 'volume-50b7eedc-661a-44a1-8329-23b65e8410b9', 'volume_size': 1, 'image_id': '5c134aab-03f3-4b6d-bf35-e4463265b42d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c134aab-03f3-4b6d-bf35-e4463265b42d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5abfcec33cd68caa0356054c1031043a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f30e8d92bb44e10b19a207974c2483c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1cabfa7b6b3bb12b74778f664fd5a2a4447b33c6d6542c3659e27f3373cb051e4bda5906cb695e8c35bed27b56430ac41b2dfbc08486fcb9f87e397ad72fdb4', 'id': '5c134aab-03f3-4b6d-bf35-e4463265b42d', 'created_at': datetime.datetime(2026, 7, 24, 13, 59, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 59, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c134aab-03f3-4b6d-bf35-e4463265b42d/file', 'properties': {}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fb7aeb-d4a6-46c3-9030-b7ffc756f0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fb7aeb-d4a6-46c3-9030-b7ffc756f0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bd8a89-9a0a-4059-851a-bc81f792d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:04 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Volume 50b7eedc-661a-44a1-8329-23b65e8410b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50b7eedc-661a-44a1-8329-23b65e8410b9', 'volume_size': 1, 'image_id': '5c134aab-03f3-4b6d-bf35-e4463265b42d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c134aab-03f3-4b6d-bf35-e4463265b42d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5abfcec33cd68caa0356054c1031043a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f30e8d92bb44e10b19a207974c2483c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1cabfa7b6b3bb12b74778f664fd5a2a4447b33c6d6542c3659e27f3373cb051e4bda5906cb695e8c35bed27b56430ac41b2dfbc08486fcb9f87e397ad72fdb4', 'id': '5c134aab-03f3-4b6d-bf35-e4463265b42d', 'created_at': datetime.datetime(2026, 7, 24, 13, 59, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 59, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c134aab-03f3-4b6d-bf35-e4463265b42d/file', 'properties': {}}, 'image_service': } Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Trying to clone 50b7eedc-661a-44a1-8329-23b65e8410b9 from image 5c134aab-03f3-4b6d-bf35-e4463265b42d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c134aab-03f3-4b6d-bf35-e4463265b42d', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:59:04 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Image download 0.00 MB at 0.00 MB/s Jul 24 15:59:04 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.869s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-67769598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c771244-f986-4886-ac15-6d27d2ff3be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:02Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Creating volume 5c771244-f986-4886-ac15-6d27d2ff3be7 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:04 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3e6ab3-c03c-415b-b0db-67a79098b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62fef836-9c17-4777-bd35-76f9d44913f1', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad639ec5-1a51-4b9a-8922-194274f7cf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:04 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 1073741824 Jul 24 15:59:04 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b05e2a-9185-4a14-9e92-d8c61210c7e7]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:04 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Volume volume-62fef836-9c17-4777-bd35-76f9d44913f1 (62fef836-9c17-4777-bd35-76f9d44913f1): created successfully Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad639ec5-1a51-4b9a-8922-194274f7cf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (0ffd8326-8f91-4184-b62e-5dbefe0a134c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:04 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-92dadfa9-a9c4-4272-9e69-93e11c2f87a6 tempest-CreateVolumesFromImageTest-1202335600 None] Created volume successfully. Jul 24 15:59:04 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD Jul 24 15:59:04 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Flow 'volume_create_manager' (b81f3cf3-8625-4919-9c4f-b245e44472ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f3e0e5-68d4-4100-bf9d-e2285bb1fa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f3e0e5-68d4-4100-bf9d-e2285bb1fa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00195d6-5c6d-424d-87d0-ddd420e7f038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c008d789e6e744ffa1735c99278b0ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:05Z,use_quota=True,user_id='6048df14df594b77b37f90ac6996afd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b1864ad-32a7-4c32-bb30-abff69cf6ed2),volume_type_id=0b1864ad-32a7-4c32-bb30-abff69cf6ed2)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69645bb6-ddcc-4d16-9088-dc9f9b98f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69645bb6-ddcc-4d16-9088-dc9f9b98f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8415abc-efb8-4761-ae8c-dcb8d6d6130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.image.glance [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Creating Keystone auth plugin from conf {{(pid=88251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:59:05 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:05 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 1073741824" returned: 0 in 0.546s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:05 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD Jul 24 15:59:05 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:05 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 Jul 24 15:59:05 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8415abc-efb8-4761-ae8c-dcb8d6d6130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a00195d6-5c6d-424d-87d0-ddd420e7f038', 'volume_name': 'volume-a00195d6-5c6d-424d-87d0-ddd420e7f038', 'volume_size': 1, 'image_id': '0606080f-27bb-4497-b48d-f5b06ff236fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0606080f-27bb-4497-b48d-f5b06ff236fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f412b461c34570912047ee91953e6d6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c008d789e6e744ffa1735c99278b0ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2432abaa630d35299192eb78de1bde0ecd3cd1da284481eeedf9b1fd2a2e1be4e84cc1074ac6a54bf4c521cba72d7db0658f22ff023fee2f1874e14dd8825716', 'id': '0606080f-27bb-4497-b48d-f5b06ff236fd', 'created_at': datetime.datetime(2026, 7, 24, 13, 59, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0606080f-27bb-4497-b48d-f5b06ff236fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219c87a5-584c-4383-a219-7a5e7045fe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219c87a5-584c-4383-a219-7a5e7045fe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6266fbd-3969-4027-b3a5-bdef425200dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Volume a00195d6-5c6d-424d-87d0-ddd420e7f038: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a00195d6-5c6d-424d-87d0-ddd420e7f038', 'volume_size': 1, 'image_id': '0606080f-27bb-4497-b48d-f5b06ff236fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0606080f-27bb-4497-b48d-f5b06ff236fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f412b461c34570912047ee91953e6d6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c008d789e6e744ffa1735c99278b0ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2432abaa630d35299192eb78de1bde0ecd3cd1da284481eeedf9b1fd2a2e1be4e84cc1074ac6a54bf4c521cba72d7db0658f22ff023fee2f1874e14dd8825716', 'id': '0606080f-27bb-4497-b48d-f5b06ff236fd', 'created_at': datetime.datetime(2026, 7, 24, 13, 59, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0606080f-27bb-4497-b48d-f5b06ff236fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Trying to clone a00195d6-5c6d-424d-87d0-ddd420e7f038 from image 0606080f-27bb-4497-b48d-f5b06ff236fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0606080f-27bb-4497-b48d-f5b06ff236fd', 'metadata': {}}]). {{(pid=88251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:59:05 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Image download 0.00 MB at 0.00 MB/s Jul 24 15:59:05 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD" returned: 1 in 0.354s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Temporary image 5c134aab-03f3-4b6d-bf35-e4463265b42d is fetched for user 79d2fee6cf0745bf8a29928f99b2e8a8. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a21f9a8-7d2c-4a1b-9fa6-3455b6814a19]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:05 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7" returned: 0 in 0.271s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.343s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-57923845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff2ec3-21de-4c71-b72f-56ac7760a536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f2fefa62719481f8e3eba7fa5775299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:02Z,use_quota=True,user_id='988c9e10b30544789a289d4800ae5439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Creating volume 37ff2ec3-21de-4c71-b72f-56ac7760a536 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:05 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:05 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 1073741824 Jul 24 15:59:05 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0f992b-5af0-436f-90c5-ea2e5c0cf1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c771244-f986-4886-ac15-6d27d2ff3be7', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6f4b7c-d24d-47e9-9086-3fe71758221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab83f41-d66b-410d-8164-7d5cc0e4b2e2]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:05 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD Jul 24 15:59:05 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Volume volume-5c771244-f986-4886-ac15-6d27d2ff3be7 (5c771244-f986-4886-ac15-6d27d2ff3be7): created successfully Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6f4b7c-d24d-47e9-9086-3fe71758221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (fd328431-2396-4d78-98ad-4f39efc1df07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6bf24f5c-4108-4a37-bc89-790d37e4ea6e tempest-CreateVolumesFromImageTest-1202335600 None] Created volume successfully. Jul 24 15:59:05 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD Jul 24 15:59:05 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:05 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:06 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD Jul 24 15:59:06 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:06 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:06 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 1073741824" returned: 0 in 0.569s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:06 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD Jul 24 15:59:06 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:06 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 Jul 24 15:59:06 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:06 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Temporary image 0606080f-27bb-4497-b48d-f5b06ff236fd is fetched for user 6048df14df594b77b37f90ac6996afd1. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e350d0e-9ab4-4b4e-ad06-9b0c88e68fb8]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:06 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:06 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536" returned: 0 in 0.277s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.520s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Creating offline snapshot a320e38d-539b-4301-9bcc-84f9dd81b2d2 of volume eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6c3c4c-532c-4de0-b31b-d70da6fb83f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ff2ec3-21de-4c71-b72f-56ac7760a536', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2250c34e-8dc5-465e-b3d6-c24e91136d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0fa8fe-3f92-4471-822e-49cdcd3f5e4d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:06 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD Jul 24 15:59:06 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:06 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Volume volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 (37ff2ec3-21de-4c71-b72f-56ac7760a536): created successfully Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2250c34e-8dc5-465e-b3d6-c24e91136d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Flow 'volume_create_manager' (20116fab-d781-46c5-96ae-222647cd7261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-accb0efc-3435-47c7-a61b-8b9300ee1b40 tempest-CreateVolumesFromImageTest-1202335600 None] Created volume successfully. Jul 24 15:59:06 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 Jul 24 15:59:06 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:06 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:06 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:06 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" returned: 0 in 0.359s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:06 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:06 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 1G Jul 24 15:59:06 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:07 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:07 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 1G" returned: 0 in 0.392s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:07 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 Jul 24 15:59:07 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:07 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:07 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 is being set with open permissions: ugo+rw Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:07 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 Jul 24 15:59:07 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-37ff2ec3-21de-4c71-b72f-56ac7760a536-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-37ff2ec3-21de-4c71-b72f-56ac7760a536-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-quobyte-37ff2ec3-21de-4c71-b72f-56ac7760a536" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-37ff2ec3-21de-4c71-b72f-56ac7760a536" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e7c427-bde1-4455-9e8f-4b0b821a86dd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:07 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2" returned: 0 in 0.260s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:07 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 Jul 24 15:59:07 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:07 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.info Jul 24 15:59:07 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:08 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536" returned: 0 in 0.395s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:08 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.info" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:08 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.info is being set with open permissions: ugo+rw Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:08 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536 Jul 24 15:59:08 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:08 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.info Jul 24 15:59:08 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:08 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-37ff2ec3-21de-4c71-b72f-56ac7760a536" returned: 0 in 0.253s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:08 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.info" returned: 0 in 0.248s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-37ff2ec3-21de-4c71-b72f-56ac7760a536" released by "delete_volume" :: held 0.716s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b7eedc-661a-44a1-8329-23b65e8410b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f30e8d92bb44e10b19a207974c2483c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:04Z,use_quota=True,user_id='79d2fee6cf0745bf8a29928f99b2e8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Creating volume 50b7eedc-661a-44a1-8329-23b65e8410b9 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:08 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:08 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 1073741824 Jul 24 15:59:08 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:08 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ef202257-68fa-49d2-a300-e3eca076af3c tempest-CreateVolumesFromSnapshotTest-20958585 None] Create snapshot completed successfully Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Created reservations ['e80d9224-a0cd-42da-a988-d50a978ab1a6', '561edc60-e518-4d63-9821-efa1de25ad11', '517914ee-d867-4691-b64c-747315242b3e', '8f995d2d-9ea1-48b7-a346-ba8c147524a6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:08 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:08 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-5c771244-f986-4886-ac15-6d27d2ff3be7-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:08 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.256s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:08 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Deleted volume successfully. Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-5c771244-f986-4886-ac15-6d27d2ff3be7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0db81b7c-c549-4d07-a5d6-3056f68b982d tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-37ff2ec3-21de-4c71-b72f-56ac7760a536-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-quobyte-5c771244-f986-4886-ac15-6d27d2ff3be7" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-5c771244-f986-4886-ac15-6d27d2ff3be7" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:08 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 1073741824" returned: 0 in 0.487s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0530eebb-9357-4573-9fac-e516c2f63e14]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:08 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 Jul 24 15:59:08 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:08 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 Jul 24 15:59:08 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:09 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.131s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00195d6-5c6d-424d-87d0-ddd420e7f038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c008d789e6e744ffa1735c99278b0ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:05Z,use_quota=True,user_id='6048df14df594b77b37f90ac6996afd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b1864ad-32a7-4c32-bb30-abff69cf6ed2),volume_type_id=0b1864ad-32a7-4c32-bb30-abff69cf6ed2)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Creating volume a00195d6-5c6d-424d-87d0-ddd420e7f038 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:09 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:09 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 1073741824 Jul 24 15:59:09 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Attempting download of 5c134aab-03f3-4b6d-bf35-e4463265b42d ((None, [{'url': 'file:///opt/stack/data/glance/images/5c134aab-03f3-4b6d-bf35-e4463265b42d', 'metadata': {}}])) to volume 50b7eedc-661a-44a1-8329-23b65e8410b9. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[80652c6b-914d-4a73-a05d-4f3d457d3330]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c134aab-03f3-4b6d-bf35-e4463265b42d_oaein1eb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:09 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7" returned: 0 in 0.472s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:09 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7 Jul 24 15:59:09 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:09 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c134aab-03f3-4b6d-bf35-e4463265b42d_oaein1eb Jul 24 15:59:09 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (5cef0ca7-2849-448f-8fb4-eb2b7af08da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0b67f2-016c-401c-8317-a2821c5ceae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0b67f2-016c-401c-8317-a2821c5ceae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-322918813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0b7e3a-06f1-4849-a2f3-35281f628b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:10Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c959cc55-cff1-4c05-b237-dc0a52b1a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c959cc55-cff1-4c05-b237-dc0a52b1a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d74fd4-a16f-42b6-9a32-c6da430ae871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d74fd4-a16f-42b6-9a32-c6da430ae871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0b7e3a-06f1-4849-a2f3-35281f628b57', 'volume_name': 'volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eb004d-8a18-48ca-94a4-5823b255c4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eb004d-8a18-48ca-94a4-5823b255c4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:09 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5358f2f3-203f-45f8-90cc-8215aadaf9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume 2a0b7e3a-06f1-4849-a2f3-35281f628b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57', 'volume_size': 1} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c134aab-03f3-4b6d-bf35-e4463265b42d_oaein1eb" returned: 0 in 0.381s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c134aab-03f3-4b6d-bf35-e4463265b42d_oaein1eb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:09 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5c771244-f986-4886-ac15-6d27d2ff3be7" returned: 0 in 0.391s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-5c771244-f986-4886-ac15-6d27d2ff3be7" released by "delete_volume" :: held 0.916s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Created reservations ['57e78d6e-3546-4dca-b2e6-15bdf502e094', '85bf5f8a-f796-4947-af47-436cb463bd0d', '7ec47220-0c81-4ea2-9c0f-b0ef97fa2d37', 'e2ee19eb-42c0-4e9e-8c92-6a5f5393eb55'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:09 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c134aab-03f3-4b6d-bf35-e4463265b42d_oaein1eb Jul 24 15:59:09 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:09 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:09 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:10 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 1073741824" returned: 0 in 0.801s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:10 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 Jul 24 15:59:10 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:10 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c134aab-03f3-4b6d-bf35-e4463265b42d_oaein1eb" returned: 1 in 0.473s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c134aab-03f3-4b6d-bf35-e4463265b42d_oaein1eb' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (d4221f47-71fd-4cbd-8676-ec14bc00ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a562921-a490-4e0e-9523-79be47fb09da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe92b1a7-b212-4e83-bad8-3a8b0dc5488a]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a562921-a490-4e0e-9523-79be47fb09da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-393999008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ba1054-3aa1-452f-9ddf-e9c5341e34e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:10Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6edf5d0d-dc5b-4199-905c-89024849025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6edf5d0d-dc5b-4199-905c-89024849025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31bc957-27b5-49dc-add8-2d27f7acf3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31bc957-27b5-49dc-add8-2d27f7acf3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ba1054-3aa1-452f-9ddf-e9c5341e34e5', 'volume_name': 'volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f914849-e774-41fd-85c8-a9f566a0bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD Jul 24 15:59:10 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f914849-e774-41fd-85c8-a9f566a0bd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f891cd42-a1ab-48d4-a255-4fcc5374c0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume 94ba1054-3aa1-452f-9ddf-e9c5341e34e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5', 'volume_size': 1} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:10 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.448s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:10 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Deleted volume successfully. Jul 24 15:59:10 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ecc8fab8-0f7d-4a22-853a-b5d21e6faa9b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-5c771244-f986-4886-ac15-6d27d2ff3be7-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038" returned: 0 in 0.365s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-322918813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0b7e3a-06f1-4849-a2f3-35281f628b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:10Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Creating volume 2a0b7e3a-06f1-4849-a2f3-35281f628b57 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:10 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:10 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 1073741824 Jul 24 15:59:10 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Attempting download of 0606080f-27bb-4497-b48d-f5b06ff236fd ((None, [{'url': 'file:///opt/stack/data/glance/images/0606080f-27bb-4497-b48d-f5b06ff236fd', 'metadata': {}}])) to volume a00195d6-5c6d-424d-87d0-ddd420e7f038. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ad85cf-2513-4dcf-ad26-1bdd355743db]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0606080f-27bb-4497-b48d-f5b06ff236fd_41vrgnt5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:10 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (31b882d1-798d-4c7c-881f-9734a75fada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2183052f-56d8-45b3-ae77-1c57d28b56de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0606080f-27bb-4497-b48d-f5b06ff236fd_41vrgnt5 Jul 24 15:59:10 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2183052f-56d8-45b3-ae77-1c57d28b56de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510220634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab20c619-5964-4297-b845-f36b6a7e93a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:11Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51eb0eea-979b-4f60-81f8-db18b4271d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51eb0eea-979b-4f60-81f8-db18b4271d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d606c6-0add-41f2-9949-99923d5efac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d606c6-0add-41f2-9949-99923d5efac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab20c619-5964-4297-b845-f36b6a7e93a8', 'volume_name': 'volume-ab20c619-5964-4297-b845-f36b6a7e93a8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7518ee-cdd6-4184-9a95-c60a547633a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7518ee-cdd6-4184-9a95-c60a547633a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5953a3f1-4574-4cde-97e3-9803030993f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume ab20c619-5964-4297-b845-f36b6a7e93a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab20c619-5964-4297-b845-f36b6a7e93a8', 'volume_size': 1} Jul 24 15:59:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:10 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD Jul 24 15:59:10 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-62fef836-9c17-4777-bd35-76f9d44913f1-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:11 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 1073741824" returned: 0 in 0.714s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-62fef836-9c17-4777-bd35-76f9d44913f1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:11 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0606080f-27bb-4497-b48d-f5b06ff236fd_41vrgnt5" returned: 0 in 0.595s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0606080f-27bb-4497-b48d-f5b06ff236fd_41vrgnt5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-quobyte-62fef836-9c17-4777-bd35-76f9d44913f1" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:11 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-62fef836-9c17-4777-bd35-76f9d44913f1" acquired by "delete_volume" :: waited 0.072s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:11 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:11 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD" returned: 1 in 0.751s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] 5c134aab-03f3-4b6d-bf35-e4463265b42d was raw, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:11 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0606080f-27bb-4497-b48d-f5b06ff236fd_41vrgnt5 Jul 24 15:59:11 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3bce16-ffb7-49e8-ae0c-62f83b929c73]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (dc95b5ea-bfc9-4154-9738-9d63fa4f7f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4ededb-b8d5-413f-a9dc-12215b50d01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:11 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 Jul 24 15:59:11 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4ededb-b8d5-413f-a9dc-12215b50d01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1516176147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d4bc10-c328-4a5a-a04f-865290d7bb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:11Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d433270-22cb-4077-98c5-8c12130c9513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d433270-22cb-4077-98c5-8c12130c9513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2dcc57-a735-44b1-b39e-b93947134c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2dcc57-a735-44b1-b39e-b93947134c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d4bc10-c328-4a5a-a04f-865290d7bb52', 'volume_name': 'volume-82d4bc10-c328-4a5a-a04f-865290d7bb52', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa13fe43-e780-4a39-8c80-64b9f1f0bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa13fe43-e780-4a39-8c80-64b9f1f0bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8480093b-533e-4b13-92ef-69c35cddf621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:11 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume 82d4bc10-c328-4a5a-a04f-865290d7bb52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d4bc10-c328-4a5a-a04f-865290d7bb52', 'volume_size': 1} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:11 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 Jul 24 15:59:11 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:11 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57" returned: 0 in 0.441s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.369s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-393999008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ba1054-3aa1-452f-9ddf-e9c5341e34e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:10Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Creating volume 94ba1054-3aa1-452f-9ddf-e9c5341e34e5 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:11 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5358f2f3-203f-45f8-90cc-8215aadaf9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4602ea1-b718-4bc1-b402-f015214db059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:11 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 1073741824 Jul 24 15:59:11 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:11 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 (2a0b7e3a-06f1-4849-a2f3-35281f628b57): created successfully Jul 24 15:59:11 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4602ea1-b718-4bc1-b402-f015214db059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (5cef0ca7-2849-448f-8fb4-eb2b7af08da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0606080f-27bb-4497-b48d-f5b06ff236fd_41vrgnt5" returned: 1 in 0.703s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0606080f-27bb-4497-b48d-f5b06ff236fd_41vrgnt5' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f54bcc-6d8e-494c-a417-5480c0b555ab]: (4, 'raw') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:11 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-56997267-6392-41e6-ad52-6fb86d9d2af1 tempest-CreateVolumesFromSnapshotTest-20958585 None] Created volume successfully. Jul 24 15:59:11 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (fc4e18e9-749b-458e-bc3d-69111af929ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1129499-3137-4e6d-84fa-3d5d478897c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1129499-3137-4e6d-84fa-3d5d478897c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313852101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5b8983-0da4-41e7-8a71-b1951a46b2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:12Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466f0b7f-c870-44f4-93a9-f77f7cc0f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466f0b7f-c870-44f4-93a9-f77f7cc0f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD Jul 24 15:59:12 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29ca34a-6510-48a3-8f16-53a62b7c0f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29ca34a-6510-48a3-8f16-53a62b7c0f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5b8983-0da4-41e7-8a71-b1951a46b2a2', 'volume_name': 'volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9c6427-4877-493f-af0f-bf1bf0ccdb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9c6427-4877-493f-af0f-bf1bf0ccdb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21228bae-43b6-48e7-8873-c819ae688df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume 3a5b8983-0da4-41e7-8a71-b1951a46b2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2', 'volume_size': 1} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:12 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1" returned: 0 in 0.709s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9" returned: 0 in 0.745s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c134aab-03f3-4b6d-bf35-e4463265b42d_n2iuntv_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:59:12 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1 Jul 24 15:59:12 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 1G Jul 24 15:59:12 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-62fef836-9c17-4777-bd35-76f9d44913f1" returned: 0 in 0.282s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-62fef836-9c17-4777-bd35-76f9d44913f1" released by "delete_volume" :: held 1.077s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:12 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 1073741824" returned: 0 in 0.691s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD Jul 24 15:59:12 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Created reservations ['e6d140a4-d799-4603-be9c-cda8d7c36953', '56c7b6cf-b181-4568-bb4d-c1760d8c2d61', '023c126a-b18b-423f-aa8a-aeccfcbc8642', '3025c1fa-374a-4d3f-9c38-1995ce6a9264'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:12 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 Jul 24 15:59:12 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 1G" returned: 0 in 0.388s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Downloaded image 5c134aab-03f3-4b6d-bf35-e4463265b42d ((None, [{'url': 'file:///opt/stack/data/glance/images/5c134aab-03f3-4b6d-bf35-e4463265b42d', 'metadata': {}}])) to volume 50b7eedc-661a-44a1-8329-23b65e8410b9 successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Temporary image 5c134aab-03f3-4b6d-bf35-e4463265b42d for user 79d2fee6cf0745bf8a29928f99b2e8a8 is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Marking volume 50b7eedc-661a-44a1-8329-23b65e8410b9 as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Copying metadata from image 5c134aab-03f3-4b6d-bf35-e4463265b42d to 50b7eedc-661a-44a1-8329-23b65e8410b9. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Creating volume glance metadata for volume 50b7eedc-661a-44a1-8329-23b65e8410b9 backed by image 5c134aab-03f3-4b6d-bf35-e4463265b42d with: {'image_id': '5c134aab-03f3-4b6d-bf35-e4463265b42d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5abfcec33cd68caa0356054c1031043a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:12 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bd8a89-9a0a-4059-851a-bc81f792d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b7eedc-661a-44a1-8329-23b65e8410b9', 'volume_size': 1, 'image_id': '5c134aab-03f3-4b6d-bf35-e4463265b42d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c134aab-03f3-4b6d-bf35-e4463265b42d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5abfcec33cd68caa0356054c1031043a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f30e8d92bb44e10b19a207974c2483c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1cabfa7b6b3bb12b74778f664fd5a2a4447b33c6d6542c3659e27f3373cb051e4bda5906cb695e8c35bed27b56430ac41b2dfbc08486fcb9f87e397ad72fdb4', 'id': '5c134aab-03f3-4b6d-bf35-e4463265b42d', 'created_at': datetime.datetime(2026, 7, 24, 13, 59, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 59, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c134aab-03f3-4b6d-bf35-e4463265b42d/file', 'properties': {}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b90bc4-76f3-42da-96c3-08390fec3ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Volume volume-50b7eedc-661a-44a1-8329-23b65e8410b9 (50b7eedc-661a-44a1-8329-23b65e8410b9): created successfully Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b90bc4-76f3-42da-96c3-08390fec3ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Flow 'volume_create_manager' (a5fb97bc-454d-4180-ae16-df2eda28ad00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:12 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] 0606080f-27bb-4497-b48d-f5b06ff236fd was raw, converting to qcow2 {{(pid=88251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-02ee5749-0d65-48e9-b152-7d4a160d14f6 tempest-VolumeImageDependencyTests-716925621 None] Created volume successfully. Jul 24 15:59:12 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 Jul 24 15:59:12 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5" returned: 0 in 0.305s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.991s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510220634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab20c619-5964-4297-b845-f36b6a7e93a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:11Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Creating volume ab20c619-5964-4297-b845-f36b6a7e93a8 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:12 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f891cd42-a1ab-48d4-a255-4fcc5374c0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb164db-5f2e-4d09-be6e-fba1def96ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 1073741824 Jul 24 15:59:12 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 (94ba1054-3aa1-452f-9ddf-e9c5341e34e5): created successfully Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb164db-5f2e-4d09-be6e-fba1def96ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (d4221f47-71fd-4cbd-8676-ec14bc00ca06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-57d83368-261d-4207-8921-1da8fcced7e9 tempest-CreateVolumesFromSnapshotTest-20958585 None] Created volume successfully. Jul 24 15:59:12 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.316s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Deleted volume successfully. Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1004f2f8-c88e-4c83-878d-5cb950931a46 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-62fef836-9c17-4777-bd35-76f9d44913f1-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:13 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038" returned: 0 in 0.496s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0606080f-27bb-4497-b48d-f5b06ff236fd_yy1vikxedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:59:13 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:13 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 1G Jul 24 15:59:13 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:13 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 1073741824" returned: 0 in 0.445s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:13 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 Jul 24 15:59:13 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-5400df6a-ab3a-43a4-814c-abea34c063d5-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-5400df6a-ab3a-43a4-814c-abea34c063d5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-quobyte-5400df6a-ab3a-43a4-814c-abea34c063d5" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-5400df6a-ab3a-43a4-814c-abea34c063d5" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff32de3-e113-4529-97bf-09bb3d5585e8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:13 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8" returned: 0 in 0.305s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1516176147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d4bc10-c328-4a5a-a04f-865290d7bb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:11Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Creating volume 82d4bc10-c328-4a5a-a04f-865290d7bb52 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:13 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:13 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 1073741824 Jul 24 15:59:13 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:13 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 Jul 24 15:59:13 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:13 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5953a3f1-4574-4cde-97e3-9803030993f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab20c619-5964-4297-b845-f36b6a7e93a8', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f72f7d2-3ebb-4cc7-a652-42570de7c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 1G" returned: 0 in 0.468s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Downloaded image 0606080f-27bb-4497-b48d-f5b06ff236fd ((None, [{'url': 'file:///opt/stack/data/glance/images/0606080f-27bb-4497-b48d-f5b06ff236fd', 'metadata': {}}])) to volume a00195d6-5c6d-424d-87d0-ddd420e7f038 successfully. {{(pid=88251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Temporary image 0606080f-27bb-4497-b48d-f5b06ff236fd for user 6048df14df594b77b37f90ac6996afd1 is deleted. {{(pid=88251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.volume_utils [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Marking volume a00195d6-5c6d-424d-87d0-ddd420e7f038 as bootable. {{(pid=88251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:59:13 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume volume-ab20c619-5964-4297-b845-f36b6a7e93a8 (ab20c619-5964-4297-b845-f36b6a7e93a8): created successfully Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f72f7d2-3ebb-4cc7-a652-42570de7c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (31b882d1-798d-4c7c-881f-9734a75fada5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Copying metadata from image 0606080f-27bb-4497-b48d-f5b06ff236fd to a00195d6-5c6d-424d-87d0-ddd420e7f038. {{(pid=88251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Creating volume glance metadata for volume a00195d6-5c6d-424d-87d0-ddd420e7f038 backed by image 0606080f-27bb-4497-b48d-f5b06ff236fd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0606080f-27bb-4497-b48d-f5b06ff236fd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f412b461c34570912047ee91953e6d6f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Acquiring lock "cinder-50b7eedc-661a-44a1-8329-23b65e8410b9-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:13 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bd5d106e-2a1c-4c7d-b617-5bd6f7980fdb tempest-CreateVolumesFromSnapshotTest-20958585 None] Created volume successfully. Jul 24 15:59:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Lock "cinder-50b7eedc-661a-44a1-8329-23b65e8410b9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Acquiring lock "cinder-quobyte-50b7eedc-661a-44a1-8329-23b65e8410b9" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Lock "cinder-quobyte-50b7eedc-661a-44a1-8329-23b65e8410b9" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6266fbd-3969-4027-b3a5-bdef425200dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00195d6-5c6d-424d-87d0-ddd420e7f038', 'volume_size': 1, 'image_id': '0606080f-27bb-4497-b48d-f5b06ff236fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0606080f-27bb-4497-b48d-f5b06ff236fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f412b461c34570912047ee91953e6d6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c008d789e6e744ffa1735c99278b0ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2432abaa630d35299192eb78de1bde0ecd3cd1da284481eeedf9b1fd2a2e1be4e84cc1074ac6a54bf4c521cba72d7db0658f22ff023fee2f1874e14dd8825716', 'id': '0606080f-27bb-4497-b48d-f5b06ff236fd', 'created_at': datetime.datetime(2026, 7, 24, 13, 59, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0606080f-27bb-4497-b48d-f5b06ff236fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3327c9-5613-4cbf-9c36-55d747332551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b9a156-1265-4433-ade1-d710e77e7bd3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:14 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Volume volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 (a00195d6-5c6d-424d-87d0-ddd420e7f038): created successfully Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3327c9-5613-4cbf-9c36-55d747332551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Flow 'volume_create_manager' (b81f3cf3-8625-4919-9c4f-b245e44472ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5" returned: 0 in 0.535s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7aad26ef-5692-4634-b832-e7af7718e476 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Created volume successfully. Jul 24 15:59:14 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5 Jul 24 15:59:14 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:14 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 Jul 24 15:59:14 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:14 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 1073741824" returned: 0 in 0.570s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:14 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 Jul 24 15:59:14 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:14 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5400df6a-ab3a-43a4-814c-abea34c063d5" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-5400df6a-ab3a-43a4-814c-abea34c063d5" released by "delete_volume" :: held 0.858s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Created reservations ['71185fe8-e2ae-4361-a206-1990fa6571e5', '9a9618b5-04b3-4b6d-aaaa-af3d00d0fe3b', '8bd2415f-63f1-4d47-98a1-aa3a79b944ff', '65ce56af-6322-4ed1-8d8e-9f9e99a86521'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:14 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9" returned: 0 in 0.423s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:14 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9 Jul 24 15:59:14 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:14 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.484s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313852101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5b8983-0da4-41e7-8a71-b1951a46b2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b7b03ae5b04075adef4d9c2543ca42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:12Z,use_quota=True,user_id='74d1bfd0fbfd491899010e3af4aa54a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Creating volume 3a5b8983-0da4-41e7-8a71-b1951a46b2a2 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:14 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:14 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:14 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8480093b-533e-4b13-92ef-69c35cddf621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d4bc10-c328-4a5a-a04f-865290d7bb52', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:14 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 1073741824 Jul 24 15:59:14 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650d25b9-8f80-46db-baa3-2e18a8ffba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 (82d4bc10-c328-4a5a-a04f-865290d7bb52): created successfully Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650d25b9-8f80-46db-baa3-2e18a8ffba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (dc95b5ea-bfc9-4154-9738-9d63fa4f7f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-cdb276e0-13f8-4f60-95aa-cce36c71b004-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-bded038d-790f-4f46-b2dc-d6750042d4db tempest-CreateVolumesFromSnapshotTest-20958585 None] Created volume successfully. Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Acquiring lock "cinder-a00195d6-5c6d-424d-87d0-ddd420e7f038-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-cdb276e0-13f8-4f60-95aa-cce36c71b004-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "cinder-a00195d6-5c6d-424d-87d0-ddd420e7f038-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "cinder-quobyte-cdb276e0-13f8-4f60-95aa-cce36c71b004" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Acquiring lock "cinder-quobyte-a00195d6-5c6d-424d-87d0-ddd420e7f038" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "cinder-quobyte-a00195d6-5c6d-424d-87d0-ddd420e7f038" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-cdb276e0-13f8-4f60-95aa-cce36c71b004" acquired by "delete_volume" :: waited 0.061s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e76e9-5d6f-426e-a06f-999005e62c44]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b6e1cf-6825-490c-b20c-cb7f11fbef7e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:14 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-50b7eedc-661a-44a1-8329-23b65e8410b9" returned: 0 in 0.488s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Lock "cinder-quobyte-50b7eedc-661a-44a1-8329-23b65e8410b9" released by "delete_volume" :: held 0.971s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:15 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.482s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Deleted volume successfully. Jul 24 15:59:15 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 Jul 24 15:59:15 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b1fa689-c296-4184-b2f2-d8d14269b984 tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-5400df6a-ab3a-43a4-814c-abea34c063d5-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:15 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Created reservations ['65998858-39ff-4fbe-9741-2eebccddd66b', '0072498a-2e48-4d5b-8f0f-7620b80760ad', '22e00ccc-d4eb-4503-979c-21c7885addd7', '10daaf5f-1509-4e0e-affb-3fa304e65ceb'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:15 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:15 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 1073741824" returned: 0 in 0.693s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:15 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 Jul 24 15:59:15 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004" returned: 0 in 0.507s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:15 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038" returned: 0 in 0.553s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:15 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004 Jul 24 15:59:15 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038 Jul 24 15:59:15 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Deleted volume successfully. Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1ec17df6-6f24-4ff4-b88e-3b11b6d05f1f tempest-VolumeImageDependencyTests-716925621 None] Lock "cinder-50b7eedc-661a-44a1-8329-23b65e8410b9-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:15 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21228bae-43b6-48e7-8873-c819ae688df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad625dbe-e103-4d35-9b74-16dcb4455f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:15 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Volume volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 (3a5b8983-0da4-41e7-8a71-b1951a46b2a2): created successfully Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad625dbe-e103-4d35-9b74-16dcb4455f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Flow 'volume_create_manager' (fc4e18e9-749b-458e-bc3d-69111af929ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:15 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cdb276e0-13f8-4f60-95aa-cce36c71b004" returned: 0 in 0.280s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5c5cf9cc-6a1e-45bf-9143-779a1cb9442f tempest-CreateVolumesFromSnapshotTest-20958585 None] Created volume successfully. Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-quobyte-cdb276e0-13f8-4f60-95aa-cce36c71b004" released by "delete_volume" :: held 0.845s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:15 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-a00195d6-5c6d-424d-87d0-ddd420e7f038" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "cinder-quobyte-a00195d6-5c6d-424d-87d0-ddd420e7f038" released by "delete_volume" :: held 0.909s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Created reservations ['4316036f-592c-4736-9513-239e4d052f21', 'df814cd9-f786-4a4e-918e-692e1df236d8', 'fe000871-a417-4ba0-b227-a3dfbac0098a', '43ceb1e1-a040-487c-9af8-2b8ecfb2c80e'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Created reservations ['35b5796f-d0bf-429c-a6ea-7e9a5a95727d', '917f6bce-f261-42f6-841d-439cc4524877', '2b407065-b0ae-413b-a51c-1b8905f36047', 'b73ccd91-cdca-4f41-af21-e87b12c3b2de'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:15 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:15 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:16 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:16 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:16 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.393s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Deleted volume successfully. Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-53e2e7e8-fa41-427c-af00-51ce2471fe5b tempest-CreateVolumesFromImageTest-1202335600 None] Lock "cinder-cdb276e0-13f8-4f60-95aa-cce36c71b004-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-3a5b8983-0da4-41e7-8a71-b1951a46b2a2-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:16 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.509s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Deleted volume successfully. Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-3a5b8983-0da4-41e7-8a71-b1951a46b2a2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-6218719d-7781-49dc-ba20-4b28dac0ffa9 tempest-VolumeAndVolumeTypeFromImageTest-795311609 None] Lock "cinder-a00195d6-5c6d-424d-87d0-ddd420e7f038-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-quobyte-3a5b8983-0da4-41e7-8a71-b1951a46b2a2" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-3a5b8983-0da4-41e7-8a71-b1951a46b2a2" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a50c0a-40e9-4a7a-84ab-ec5def3ae804]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:16 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 Jul 24 15:59:16 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:17 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2" returned: 0 in 0.392s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:17 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2 Jul 24 15:59:17 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:17 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-3a5b8983-0da4-41e7-8a71-b1951a46b2a2" returned: 0 in 0.311s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-3a5b8983-0da4-41e7-8a71-b1951a46b2a2" released by "delete_volume" :: held 0.757s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Created reservations ['18888ff3-86d1-4a70-8ff3-22e6d3254243', 'e9c7b71d-6808-4ab2-8465-437d44a98563', '5734b37c-a0a0-4dec-b0dd-dd2b97b905ff', '879a41f9-d76d-46c4-99e4-c13525595abf'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:17 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:17 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-82d4bc10-c328-4a5a-a04f-865290d7bb52-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-82d4bc10-c328-4a5a-a04f-865290d7bb52-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-quobyte-82d4bc10-c328-4a5a-a04f-865290d7bb52" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-82d4bc10-c328-4a5a-a04f-865290d7bb52" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83c6137-2399-4df3-be08-6cbce5efb512]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:17 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.414s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:17 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Deleted volume successfully. Jul 24 15:59:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-01f88595-1630-4056-9755-a57ddf7691cc tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-3a5b8983-0da4-41e7-8a71-b1951a46b2a2-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:18 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 Jul 24 15:59:18 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:18 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52" returned: 0 in 0.474s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:18 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52 Jul 24 15:59:18 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:18 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-82d4bc10-c328-4a5a-a04f-865290d7bb52" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-82d4bc10-c328-4a5a-a04f-865290d7bb52" released by "delete_volume" :: held 0.850s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Created reservations ['f2cfa50c-4a06-4f4d-839f-7c3182c767d2', '22ee11c7-ae2a-4ce3-a3e4-e79a31fbfcca', '5bb0b754-8ab4-4527-ab02-91b613222c7d', 'a6977f69-68c9-4864-b694-f36a64916d39'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:18 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:18 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:18 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-ab20c619-5964-4297-b845-f36b6a7e93a8-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-ab20c619-5964-4297-b845-f36b6a7e93a8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-quobyte-ab20c619-5964-4297-b845-f36b6a7e93a8" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-ab20c619-5964-4297-b845-f36b6a7e93a8" acquired by "delete_volume" :: waited 0.035s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b522e3b-e506-46bf-b833-69a06e0beeb6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:19 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.462s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:19 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Deleted volume successfully. Jul 24 15:59:19 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 Jul 24 15:59:19 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d063b0ae-4cea-4468-8683-165e408d2276 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-82d4bc10-c328-4a5a-a04f-865290d7bb52-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:19 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8" returned: 0 in 0.450s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:19 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8 Jul 24 15:59:19 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:20 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ab20c619-5964-4297-b845-f36b6a7e93a8" returned: 0 in 0.370s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-ab20c619-5964-4297-b845-f36b6a7e93a8" released by "delete_volume" :: held 0.893s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Created reservations ['25bdabc4-d478-439f-ac3c-9c99796f9e01', '4b033176-5801-4d57-9259-bd4c3ca9dc3d', '8484d31d-2fcc-49b9-b8ee-a4db4cae86a5', 'aadf03b4-4d4f-4729-8fa1-58f47bd71ba8'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:20 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:20 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:20 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.319s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:20 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Deleted volume successfully. Jul 24 15:59:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-778f5b21-2372-4682-9dd3-41f8e6d776f3 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-ab20c619-5964-4297-b845-f36b6a7e93a8-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-94ba1054-3aa1-452f-9ddf-e9c5341e34e5-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-94ba1054-3aa1-452f-9ddf-e9c5341e34e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-quobyte-94ba1054-3aa1-452f-9ddf-e9c5341e34e5" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-94ba1054-3aa1-452f-9ddf-e9c5341e34e5" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33b74f6-24c1-4a6e-bb8b-674d0e8c4069]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Flow 'volume_create_manager' (09f23706-da24-4d38-a1f8-fc4ef237d381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69151cff-86c0-4160-b656-27a1fddada01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69151cff-86c0-4160-b656-27a1fddada01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2095953311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdb7a29-040a-4611-be19-5f55bd6059b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a4fbb23d4cd1bc06e79aef0a2cc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:21Z,use_quota=True,user_id='0672e897cb414c38b97ebf0863203c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ece0fbd-e7f2-4e89-bc0d-91c7cd8a47b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ece0fbd-e7f2-4e89-bc0d-91c7cd8a47b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d281c4-fb18-470a-b0d7-722b02ec630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d281c4-fb18-470a-b0d7-722b02ec630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cdb7a29-040a-4611-be19-5f55bd6059b0', 'volume_name': 'volume-1cdb7a29-040a-4611-be19-5f55bd6059b0', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729642a9-11c2-42d5-9b11-ef900422aac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729642a9-11c2-42d5-9b11-ef900422aac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9baa3b-0d6c-4c24-b623-4b6010357c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Volume 1cdb7a29-040a-4611-be19-5f55bd6059b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cdb7a29-040a-4611-be19-5f55bd6059b0', 'volume_size': 1} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:21 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2095953311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdb7a29-040a-4611-be19-5f55bd6059b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a4fbb23d4cd1bc06e79aef0a2cc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:21Z,use_quota=True,user_id='0672e897cb414c38b97ebf0863203c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Creating volume 1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:21 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:21 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:21 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 1073741824 Jul 24 15:59:21 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Flow 'volume_create_manager' (14a86ab5-67e7-48fb-91f7-098036b2014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5060d4-6f6d-4573-ba9e-99b78836692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5060d4-6f6d-4573-ba9e-99b78836692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1ff432-051e-47b4-9175-1aa4411b6913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c2405a88ad847539e936219415ace2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:22Z,use_quota=True,user_id='9dcced4d83a74ece9dbff7d21304527f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4ee8fd-10bf-41d6-b31c-5448243e1240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4ee8fd-10bf-41d6-b31c-5448243e1240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b1c17a-fcea-41fc-9258-0098d2ed6c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b1c17a-fcea-41fc-9258-0098d2ed6c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba1ff432-051e-47b4-9175-1aa4411b6913', 'volume_name': 'volume-ba1ff432-051e-47b4-9175-1aa4411b6913', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3dce2f-81a0-45e3-8a43-a8a4dbd23628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3dce2f-81a0-45e3-8a43-a8a4dbd23628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2a769f-34f7-451b-b849-a7fbd67da646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Volume ba1ff432-051e-47b4-9175-1aa4411b6913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba1ff432-051e-47b4-9175-1aa4411b6913', 'volume_size': 1} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:21 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5" returned: 0 in 0.473s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:21 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5 Jul 24 15:59:21 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 1073741824" returned: 0 in 0.536s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:22 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 Jul 24 15:59:22 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-94ba1054-3aa1-452f-9ddf-e9c5341e34e5" returned: 0 in 0.316s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-94ba1054-3aa1-452f-9ddf-e9c5341e34e5" released by "delete_volume" :: held 0.842s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Created reservations ['22c1d7b7-f40e-4bb0-b272-794e10c0472a', '9508a1a7-acc5-452a-904c-28867d82baec', '47fb8873-80f0-425f-918d-208e2568aa53', '5ab41fac-b4ba-4461-a500-036758289e64'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:22 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:22 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0" returned: 0 in 0.344s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1ff432-051e-47b4-9175-1aa4411b6913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c2405a88ad847539e936219415ace2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:22Z,use_quota=True,user_id='9dcced4d83a74ece9dbff7d21304527f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Creating volume ba1ff432-051e-47b4-9175-1aa4411b6913 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:22 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-2a0b7e3a-06f1-4849-a2f3-35281f628b57-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:22 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 1073741824 Jul 24 15:59:22 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9baa3b-0d6c-4c24-b623-4b6010357c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdb7a29-040a-4611-be19-5f55bd6059b0', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea2bfef-3833-4527-b4ad-3af8d1007752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-2a0b7e3a-06f1-4849-a2f3-35281f628b57-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:22 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Volume volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 (1cdb7a29-040a-4611-be19-5f55bd6059b0): created successfully Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea2bfef-3833-4527-b4ad-3af8d1007752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Flow 'volume_create_manager' (09f23706-da24-4d38-a1f8-fc4ef237d381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:22 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7fecf8de-6e29-4456-bbf4-10f1ec45d250 tempest-VolumeDependencyTests-1184420919 None] Created volume successfully. Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-quobyte-2a0b7e3a-06f1-4849-a2f3-35281f628b57" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-2a0b7e3a-06f1-4849-a2f3-35281f628b57" acquired by "delete_volume" :: waited 0.041s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:22 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.374s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:22 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Deleted volume successfully. Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef537d9-6a8e-4dfc-a506-777f850a093d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aafe38bc-3394-401d-857d-adb3eeabb9ec tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-94ba1054-3aa1-452f-9ddf-e9c5341e34e5-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (fe176ee4-71f5-4144-a6c4-1ac63a3f6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51173d28-299b-4e30-bdda-865e2c6a5d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51173d28-299b-4e30-bdda-865e2c6a5d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1398481652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0f4af5-29e3-42bc-a941-38d5d9720d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:23Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:22 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 Jul 24 15:59:22 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434e1c86-45ae-40b2-aeb2-0215eeb6e142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434e1c86-45ae-40b2-aeb2-0215eeb6e142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3130af18-bf2a-46b6-a84b-b4c4e61342d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3130af18-bf2a-46b6-a84b-b4c4e61342d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0f4af5-29e3-42bc-a941-38d5d9720d1c', 'volume_name': 'volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8be6da-5da2-47f9-817e-ab6053f8b367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8be6da-5da2-47f9-817e-ab6053f8b367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693afc66-b4cd-4cf0-8504-9a7ec9fdcc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:22 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume cc0f4af5-29e3-42bc-a941-38d5d9720d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c', 'volume_size': 1} Jul 24 15:59:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:23 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 1073741824" returned: 0 in 0.513s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:23 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 Jul 24 15:59:23 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:23 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57" returned: 0 in 0.423s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:23 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57 Jul 24 15:59:23 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:23 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913" returned: 0 in 0.267s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1398481652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0f4af5-29e3-42bc-a941-38d5d9720d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:23Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Creating volume cc0f4af5-29e3-42bc-a941-38d5d9720d1c {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:23 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2a769f-34f7-451b-b849-a7fbd67da646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba1ff432-051e-47b4-9175-1aa4411b6913', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66e654f-2dc2-40f1-8257-18eb8f341c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:23 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c 1073741824 Jul 24 15:59:23 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:23 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Volume volume-ba1ff432-051e-47b4-9175-1aa4411b6913 (ba1ff432-051e-47b4-9175-1aa4411b6913): created successfully Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66e654f-2dc2-40f1-8257-18eb8f341c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Flow 'volume_create_manager' (14a86ab5-67e7-48fb-91f7-098036b2014e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7873bbb0-719c-4338-9295-b95aad566adf tempest-CinderUnicodeTest-1366964241 None] Created volume successfully. Jul 24 15:59:23 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2a0b7e3a-06f1-4849-a2f3-35281f628b57" returned: 0 in 0.300s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-2a0b7e3a-06f1-4849-a2f3-35281f628b57" released by "delete_volume" :: held 0.788s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Created reservations ['cb2c94aa-1bd0-4add-a529-b7549d0af387', 'e482d594-ad24-4bda-8549-f625a2ae75d6', 'dda1bbcd-27cc-4105-a416-fa6a4614b9a0', '545ef520-8eab-45ad-ad5e-119b5b54202a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:23 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:23 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:23 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c 1073741824" returned: 0 in 0.572s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:23 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c Jul 24 15:59:23 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:24 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.296s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Deleted volume successfully. Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-92fe645d-c06b-48ed-bade-fb3476a03390 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-2a0b7e3a-06f1-4849-a2f3-35281f628b57-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:24 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c" returned: 0 in 0.269s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.567s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693afc66-b4cd-4cf0-8504-9a7ec9fdcc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04188904-86c1-4cae-9e1e-ebf5256fa8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Creating offline snapshot 8ee68dda-5fdc-44eb-9682-b148127c1ed9 of volume 1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:59:24 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c (cc0f4af5-29e3-42bc-a941-38d5d9720d1c): created successfully Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04188904-86c1-4cae-9e1e-ebf5256fa8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (fe176ee4-71f5-4144-a6c4-1ac63a3f6832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcf9da0-305d-4192-b919-283a7e4fadae]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Flow 'volume_create_manager' (83aa98b9-28cc-4104-8a47-dfe2e311f569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8636e037-a363-4759-8fa3-eb24f260b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-22e1619c-b5c4-4742-a893-ab23338b3ef3 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created volume successfully. Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8636e037-a363-4759-8fa3-eb24f260b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-688538146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef247db6-f01d-4cf6-9cda-540873b8e83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c2405a88ad847539e936219415ace2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:24Z,use_quota=True,user_id='9dcced4d83a74ece9dbff7d21304527f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc7f37f-3c25-43a9-a2b4-3e685dbe62d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc7f37f-3c25-43a9-a2b4-3e685dbe62d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434146c8-6746-4938-8179-bb7d35b2a837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434146c8-6746-4938-8179-bb7d35b2a837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef247db6-f01d-4cf6-9cda-540873b8e83d', 'volume_name': 'volume-ef247db6-f01d-4cf6-9cda-540873b8e83d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7036ed65-f930-4a23-b316-878667f92fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7036ed65-f930-4a23-b316-878667f92fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea4a726-f8d6-4fc0-824a-c6dce1f7545d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:24 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Volume ef247db6-f01d-4cf6-9cda-540873b8e83d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef247db6-f01d-4cf6-9cda-540873b8e83d', 'volume_size': 1} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:24 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 Jul 24 15:59:24 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:24 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0" returned: 0 in 0.357s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:24 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 1G Jul 24 15:59:24 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-a320e38d-539b-4301-9bcc-84f9dd81b2d2-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-a320e38d-539b-4301-9bcc-84f9dd81b2d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-quobyte-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-quobyte-a320e38d-539b-4301-9bcc-84f9dd81b2d2" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-a320e38d-539b-4301-9bcc-84f9dd81b2d2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Deleting offline snapshot a320e38d-539b-4301-9bcc-84f9dd81b2d2 of volume eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] snapshot_file for this snap is: volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[72527e57-f7c6-4c9b-8068-0866bb8ab15c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:24 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 Jul 24 15:59:24 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:25 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 1G" returned: 0 in 0.455s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:25 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 Jul 24 15:59:25 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:25 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2" returned: 0 in 0.433s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d583985c-21bd-42b5-9ba6-7dd8e7dbe40f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:25 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 Jul 24 15:59:25 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (07d3dac5-a078-465d-bced-645298ea3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f762601-a89b-483e-b29f-34241aea5316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f762601-a89b-483e-b29f-34241aea5316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937780432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0473e948-2a51-4467-934e-47250f8c338a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:25Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2017aedb-dc01-4244-aed8-3d01d79e35b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2017aedb-dc01-4244-aed8-3d01d79e35b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:25 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fece4ca-3ee8-4cc8-8cdb-e44413f605e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fece4ca-3ee8-4cc8-8cdb-e44413f605e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0473e948-2a51-4467-934e-47250f8c338a', 'volume_name': 'volume-0473e948-2a51-4467-934e-47250f8c338a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb88764-dfb8-46cc-95cb-55e5a0f984ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb88764-dfb8-46cc-95cb-55e5a0f984ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab8975a-3833-44a5-8c57-1e5ff0150199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume 0473e948-2a51-4467-934e-47250f8c338a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0473e948-2a51-4467-934e-47250f8c338a', 'volume_size': 1} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9" returned: 0 in 0.464s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:25 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 is being set with open permissions: ugo+rw Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:25 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 Jul 24 15:59:25 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:25 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" returned: 0 in 0.473s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:25 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 Jul 24 15:59:25 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:25 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (1ce395be-ce94-496b-8bfd-b6da2cb85b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064f2efc-3181-47ff-9491-8842a8c5aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9" returned: 0 in 0.367s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064f2efc-3181-47ff-9491-8842a8c5aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966510598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b656122e-91f8-476a-b000-5bfecc18eefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:26Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46aa6558-cd08-433f-9eda-227c2b5fc88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46aa6558-cd08-433f-9eda-227c2b5fc88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e988069d-9e5e-4e61-9306-e80cfdf7f2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e988069d-9e5e-4e61-9306-e80cfdf7f2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b656122e-91f8-476a-b000-5bfecc18eefb', 'volume_name': 'volume-b656122e-91f8-476a-b000-5bfecc18eefb', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d72cfe6-b13a-46c0-bd46-0cd12f445b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d72cfe6-b13a-46c0-bd46-0cd12f445b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9d3cfb-a4ec-4f9a-a6ab-cc1b0a6ff964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume b656122e-91f8-476a-b000-5bfecc18eefb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b656122e-91f8-476a-b000-5bfecc18eefb', 'volume_size': 1} Jul 24 15:59:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:26 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.info Jul 24 15:59:26 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:26 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2" returned: 0 in 0.479s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:26 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2 Jul 24 15:59:26 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:26 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (b2f0173e-3675-4409-a8fc-501972a5c7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718146e5-4e83-41c3-80e8-41c317caf877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.info" returned: 0 in 0.365s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:26 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.info is being set with open permissions: ugo+rw Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718146e5-4e83-41c3-80e8-41c317caf877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147952325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dd922b-a87b-40a0-8c7c-998e1b542027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:26Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:26 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.info Jul 24 15:59:26 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e455ae24-c7e0-4970-9ef1-a4eeeb4040ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e455ae24-c7e0-4970-9ef1-a4eeeb4040ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f85b4c-5d9e-496a-a519-241389042a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f85b4c-5d9e-496a-a519-241389042a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35dd922b-a87b-40a0-8c7c-998e1b542027', 'volume_name': 'volume-35dd922b-a87b-40a0-8c7c-998e1b542027', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7726f85-ec6e-43a8-b575-972fde422df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7726f85-ec6e-43a8-b575-972fde422df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b9ad39-fdce-4cd8-b773-88d9985520df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume 35dd922b-a87b-40a0-8c7c-998e1b542027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35dd922b-a87b-40a0-8c7c-998e1b542027', 'volume_size': 1} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:26 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822.a320e38d-539b-4301-9bcc-84f9dd81b2d2" returned: 0 in 0.340s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-a320e38d-539b-4301-9bcc-84f9dd81b2d2" released by "_delete_snapshot" :: held 1.890s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" released by "delete_snapshot" :: held 1.925s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:26 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.info" returned: 0 in 0.323s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.355s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-688538146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef247db6-f01d-4cf6-9cda-540873b8e83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c2405a88ad847539e936219415ace2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:24Z,use_quota=True,user_id='9dcced4d83a74ece9dbff7d21304527f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Creating volume ef247db6-f01d-4cf6-9cda-540873b8e83d {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:26 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:26 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d 1073741824 Jul 24 15:59:26 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6adf7970-cdad-454a-9b72-d1fd80d26ab8 tempest-VolumeDependencyTests-1184420919 None] Create snapshot completed successfully Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (9adedf50-519b-47a2-9517-32aab69eb8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7644f5d0-ebb4-4a60-9ffe-fdcb6b86d7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7644f5d0-ebb4-4a60-9ffe-fdcb6b86d7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2137384609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46210bdc-5360-48ce-8a35-eb3592601a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:27Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4d9a08-131f-4c5f-9113-8d1ffd238fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4d9a08-131f-4c5f-9113-8d1ffd238fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4534f7bd-716b-4f4b-ab04-a3691bc80a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4534f7bd-716b-4f4b-ab04-a3691bc80a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46210bdc-5360-48ce-8a35-eb3592601a25', 'volume_name': 'volume-46210bdc-5360-48ce-8a35-eb3592601a25', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2a75b8-014f-48ea-b998-90577249b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2a75b8-014f-48ea-b998-90577249b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a396cf77-5c14-4cb7-899d-83dc5940e3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:26 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume 46210bdc-5360-48ce-8a35-eb3592601a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46210bdc-5360-48ce-8a35-eb3592601a25', 'volume_size': 1} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Created reservations ['80deb0f8-dec7-4ec0-ad1d-4e43ab3fbd22', '76a1375f-355e-4d29-b3ec-5149f0551f7c', 'c3256d29-2325-4d1d-83a6-b116045d6c29', 'e1d63ab1-e6c4-44ae-9525-2f9f21654d37'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Delete snapshot completed successfully. Jul 24 15:59:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93d47891-af1a-4f11-bad1-2b0baf86df27 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-a320e38d-539b-4301-9bcc-84f9dd81b2d2-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:27 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (130e477c-147d-4311-9f44-8513c96844b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d5a2df-769a-4dab-ae11-7192f638d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d 1073741824" returned: 0 in 0.480s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d5a2df-769a-4dab-ae11-7192f638d600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8383644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7502e415-c0fa-4aea-b2b1-c4f9a5be9d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:27Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343d2764-1b8a-4319-b2b9-ede1f7d332a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343d2764-1b8a-4319-b2b9-ede1f7d332a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94a5bbb-87ee-44dd-afd8-d1d14b4c8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94a5bbb-87ee-44dd-afd8-d1d14b4c8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7502e415-c0fa-4aea-b2b1-c4f9a5be9d31', 'volume_name': 'volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e802db-1010-4bc0-8ed3-7ce2706cf474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e802db-1010-4bc0-8ed3-7ce2706cf474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009b927e-1b24-4675-b276-ee6415862365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:27 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume 7502e415-c0fa-4aea-b2b1-c4f9a5be9d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31', 'volume_size': 1} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:27 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d Jul 24 15:59:27 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:27 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d" returned: 0 in 0.244s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937780432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0473e948-2a51-4467-934e-47250f8c338a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:25Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Creating volume 0473e948-2a51-4467-934e-47250f8c338a {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:27 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea4a726-f8d6-4fc0-824a-c6dce1f7545d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef247db6-f01d-4cf6-9cda-540873b8e83d', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:27 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a 1073741824 Jul 24 15:59:27 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3df5a99-3515-4509-9dba-dc9c0d760e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:27 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Volume volume-ef247db6-f01d-4cf6-9cda-540873b8e83d (ef247db6-f01d-4cf6-9cda-540873b8e83d): created successfully Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3df5a99-3515-4509-9dba-dc9c0d760e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Flow 'volume_create_manager' (83aa98b9-28cc-4104-8a47-dfe2e311f569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f5d2e254-b146-4c20-a3b0-59b4d657e9fa tempest-CinderUnicodeTest-1366964241 None] Created volume successfully. Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "cinder-quobyte-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:28 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a 1073741824" returned: 0 in 0.514s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98c8f71-30df-4708-8c67-985e684e8106]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:28 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a Jul 24 15:59:28 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:28 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 Jul 24 15:59:28 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Flow 'volume_create_manager' (e3093199-f916-4e8b-9cd5-52c08139679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fb0337-fec0-41ff-866d-2f7bb618d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:28 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fb0337-fec0-41ff-866d-2f7bb618d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1722254808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c23de6d-9637-4287-ae3a-14852064f8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f031a4fbb23d4cd1bc06e79aef0a2cc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ee68dda-5fdc-44eb-9682-b148127c1ed9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:28Z,use_quota=True,user_id='0672e897cb414c38b97ebf0863203c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f7a31a-68b5-4e0d-8b59-df560dd66498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f7a31a-68b5-4e0d-8b59-df560dd66498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f01309-b013-4dd0-89c2-3f1aa95ab2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f01309-b013-4dd0-89c2-3f1aa95ab2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c23de6d-9637-4287-ae3a-14852064f8d0', 'volume_name': 'volume-8c23de6d-9637-4287-ae3a-14852064f8d0', 'volume_size': 1, 'snapshot_id': '8ee68dda-5fdc-44eb-9682-b148127c1ed9'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3111f8-7151-4003-a7ad-973adc67c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3111f8-7151-4003-a7ad-973adc67c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e010af-760f-433d-926d-614e6a8bf163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:28 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Volume 8c23de6d-9637-4287-ae3a-14852064f8d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c23de6d-9637-4287-ae3a-14852064f8d0', 'volume_size': 1, 'snapshot_id': '8ee68dda-5fdc-44eb-9682-b148127c1ed9'} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966510598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b656122e-91f8-476a-b000-5bfecc18eefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:26Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Creating volume b656122e-91f8-476a-b000-5bfecc18eefb {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:28 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:28 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb 1073741824 Jul 24 15:59:28 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab8975a-3833-44a5-8c57-1e5ff0150199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0473e948-2a51-4467-934e-47250f8c338a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:28 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2ddf20-40b6-4a68-8ab0-25336e478356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" returned: 0 in 0.457s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:28 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume volume-0473e948-2a51-4467-934e-47250f8c338a (0473e948-2a51-4467-934e-47250f8c338a): created successfully Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2ddf20-40b6-4a68-8ab0-25336e478356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:28 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822 Jul 24 15:59:28 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (07d3dac5-a078-465d-bced-645298ea3058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-daafa6eb-de16-4a6b-8d00-15241e1ae385 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created volume successfully. Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:28 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" returned: 0 in 0.326s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-quobyte-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822" released by "delete_volume" :: held 0.858s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:28 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Created reservations ['acdb53e0-82a4-4c1e-906b-f486d0feb93e', '545b16b0-0501-4174-af1f-af50c7abe5e1', '79791690-e2e8-48a5-ad67-3243ad7e1102', 'f08abace-dc4c-4f84-8b9f-b12eb30bb1d1'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:28 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb 1073741824" returned: 0 in 0.488s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:29 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:29 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:29 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb Jul 24 15:59:29 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:29 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.290s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Deleted volume successfully. Jul 24 15:59:29 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb" returned: 0 in 0.284s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-faf90b3d-d307-4abe-b764-275dd46d5946 tempest-CreateVolumesFromSnapshotTest-20958585 None] Lock "cinder-eb2f6a5a-0b99-42d3-8c0f-5d444ac47822-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.897s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147952325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dd922b-a87b-40a0-8c7c-998e1b542027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:26Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Creating volume 35dd922b-a87b-40a0-8c7c-998e1b542027 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:29 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9d3cfb-a4ec-4f9a-a6ab-cc1b0a6ff964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b656122e-91f8-476a-b000-5bfecc18eefb', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b067e8-3fd5-4f30-9b2f-13276d350d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:29 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 1073741824 Jul 24 15:59:29 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:29 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume volume-b656122e-91f8-476a-b000-5bfecc18eefb (b656122e-91f8-476a-b000-5bfecc18eefb): created successfully Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b067e8-3fd5-4f30-9b2f-13276d350d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (1ce395be-ce94-496b-8bfd-b6da2cb85b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:29 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-63e8094f-8a0b-4e7b-97df-986bd3cbe438 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created volume successfully. Jul 24 15:59:29 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 1073741824" returned: 0 in 0.462s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:29 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 Jul 24 15:59:29 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:30 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2137384609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46210bdc-5360-48ce-8a35-eb3592601a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:27Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Creating volume 46210bdc-5360-48ce-8a35-eb3592601a25 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:30 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b9ad39-fdce-4cd8-b773-88d9985520df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35dd922b-a87b-40a0-8c7c-998e1b542027', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:30 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 1073741824 Jul 24 15:59:30 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b2f4a7-5223-44f4-ab20-5220b9eaea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:30 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume volume-35dd922b-a87b-40a0-8c7c-998e1b542027 (35dd922b-a87b-40a0-8c7c-998e1b542027): created successfully Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b2f4a7-5223-44f4-ab20-5220b9eaea2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (b2f0173e-3675-4409-a8fc-501972a5c7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ff840692-037c-46f6-bf8d-46297fcb1d74 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created volume successfully. Jul 24 15:59:30 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 1073741824" returned: 0 in 0.497s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:30 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 Jul 24 15:59:30 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:30 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.711s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8383644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7502e415-c0fa-4aea-b2b1-c4f9a5be9d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e50be6303cc4706bf8f8ab05c1f99e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:27Z,use_quota=True,user_id='aafd9ebd99a54f4e89124ca7829f2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Creating volume 7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:30 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:31 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 1073741824 Jul 24 15:59:31 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a396cf77-5c14-4cb7-899d-83dc5940e3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46210bdc-5360-48ce-8a35-eb3592601a25', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363472ce-a930-47f6-9edc-854c7dcf1081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:31 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume volume-46210bdc-5360-48ce-8a35-eb3592601a25 (46210bdc-5360-48ce-8a35-eb3592601a25): created successfully Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363472ce-a930-47f6-9edc-854c7dcf1081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (9adedf50-519b-47a2-9517-32aab69eb8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6817a39d-6056-4336-bde2-1d21e5401ec1 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created volume successfully. Jul 24 15:59:31 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 1073741824" returned: 0 in 0.442s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:31 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 Jul 24 15:59:31 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:31 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31" returned: 0 in 0.268s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.218s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-quobyte-8ee68dda-5fdc-44eb-9682-b148127c1ed9-8c23de6d-9637-4287-ae3a-14852064f8d0" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009b927e-1b24-4675-b276-ee6415862365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccfea66-a559-4161-9b5a-3ec685c07891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:31 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Volume volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 (7502e415-c0fa-4aea-b2b1-c4f9a5be9d31): created successfully Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccfea66-a559-4161-9b5a-3ec685c07891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Flow 'volume_create_manager' (130e477c-147d-4311-9f44-8513c96844b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-8ee68dda-5fdc-44eb-9682-b148127c1ed9-8c23de6d-9637-4287-ae3a-14852064f8d0" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Creating volume 8c23de6d-9637-4287-ae3a-14852064f8d0 from snapshot 8ee68dda-5fdc-44eb-9682-b148127c1ed9 {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-quobyte-8c23de6d-9637-4287-ae3a-14852064f8d0" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5bebcb93-844c-444d-a3e4-50b3f6e1d6ae tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created volume successfully. Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-8c23de6d-9637-4287-ae3a-14852064f8d0" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] snapshot: 8ee68dda-5fdc-44eb-9682-b148127c1ed9, volume: 8c23de6d-9637-4287-ae3a-14852064f8d0, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[494e22b6-cb13-4f26-98a6-1a701874eceb]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:32 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 Jul 24 15:59:32 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:32 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9" returned: 0 in 0.396s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cdb7a29-040a-4611-be19-5f55bd6059b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[042976bb-b84c-4dca-a917-b7fe85fcf15e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:32 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 Jul 24 15:59:32 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:32 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0" returned: 0 in 0.375s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:32 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 Jul 24 15:59:32 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-quobyte-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d507ef-978a-4d6f-ba05-c4726fde4d17]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (5e5d6cab-5fa1-46cd-9d78-7fc16bfb4485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218f4d57-07ec-4983-b430-81b2838f3616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218f4d57-07ec-4983-b430-81b2838f3616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1587595346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36afedc6-5542-483e-8187-5843447af50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:33Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcabfa8-0c2e-43e0-889e-b99eb4c088fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcabfa8-0c2e-43e0-889e-b99eb4c088fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505591e5-9fb4-4eb8-bb06-c2483b1a5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505591e5-9fb4-4eb8-bb06-c2483b1a5295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36afedc6-5542-483e-8187-5843447af50b', 'volume_name': 'volume-36afedc6-5542-483e-8187-5843447af50b', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:33 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 Jul 24 15:59:33 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6686b9-27fd-4e5a-b86b-2dd78d954e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6686b9-27fd-4e5a-b86b-2dd78d954e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66840316-0804-4556-a900-0a8922fe91c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:33 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Volume 36afedc6-5542-483e-8187-5843447af50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36afedc6-5542-483e-8187-5843447af50b', 'volume_size': 1} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:33 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31" returned: 0 in 0.511s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:33 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31 Jul 24 15:59:33 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:34 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31" returned: 0 in 0.518s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31" released by "delete_volume" :: held 1.101s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created reservations ['d90c394a-35df-4d73-8d60-2b1603b5e03c', '8732528d-1fbf-4449-95b8-96295aff5423', 'f499e60a-b325-46a9-b09f-9bc577ab94f1', 'afc4e90c-311c-4cb6-ad56-d7f999d01023'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:34 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:34 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:59:34 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:59:35 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.544s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Deleted volume successfully. Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-1f99a11e-e1c3-4fd5-920b-6613cfacc893 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-7502e415-c0fa-4aea-b2b1-c4f9a5be9d31-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-46210bdc-5360-48ce-8a35-eb3592601a25-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-46210bdc-5360-48ce-8a35-eb3592601a25-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-quobyte-46210bdc-5360-48ce-8a35-eb3592601a25" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-46210bdc-5360-48ce-8a35-eb3592601a25" acquired by "delete_volume" :: waited 0.033s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3016db2b-dccf-4cba-b3b0-d74f046f2e1d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:35 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 Jul 24 15:59:35 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:36 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25" returned: 0 in 0.809s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:36 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25 Jul 24 15:59:36 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:37 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-46210bdc-5360-48ce-8a35-eb3592601a25" returned: 0 in 0.730s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-46210bdc-5360-48ce-8a35-eb3592601a25" released by "delete_volume" :: held 1.633s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created reservations ['9134ae5a-0a87-426b-9a6f-a60576798054', '835770c9-e114-4898-8f1e-6db284980dfa', '36de803f-ea6f-46ec-986e-e266b7e2fd77', '6f501f4d-ef32-42b7-8722-378f5d1238b7'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:37 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:37 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:37 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0" returned: 0 in 4.755s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5c188e-9a50-4152-aa93-5314ffcfebff]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:37 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 Jul 24 15:59:37 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:37 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.252s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:37 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Deleted volume successfully. Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-35dd922b-a87b-40a0-8c7c-998e1b542027-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-217809a8-5b49-477b-8031-396f7f16cb03 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-46210bdc-5360-48ce-8a35-eb3592601a25-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-35dd922b-a87b-40a0-8c7c-998e1b542027-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-quobyte-35dd922b-a87b-40a0-8c7c-998e1b542027" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-35dd922b-a87b-40a0-8c7c-998e1b542027" acquired by "delete_volume" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e68b1c2-5fea-4e0b-8bb7-e6c9962e1cf1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:37 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 Jul 24 15:59:37 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:38 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0" returned: 0 in 0.561s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:59:38 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Converted 1024.00 MB image at 215.29 MB/s Jul 24 15:59:38 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 is being set with open permissions: ugo+rw Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:38 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 Jul 24 15:59:38 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:38 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027" returned: 0 in 0.381s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:38 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027 Jul 24 15:59:38 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:38 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-8c23de6d-9637-4287-ae3a-14852064f8d0" released by "_copy_volume_from_snapshot" :: held 6.464s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-8ee68dda-5fdc-44eb-9682-b148127c1ed9-8c23de6d-9637-4287-ae3a-14852064f8d0" released by "_create_volume_from_snapshot" :: held 6.505s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.558s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.515s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Creating offline snapshot 4380a474-5377-415f-8339-f179e6dc4d05 of volume ef247db6-f01d-4cf6-9cda-540873b8e83d {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e010af-760f-433d-926d-614e6a8bf163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c23de6d-9637-4287-ae3a-14852064f8d0', 'volume_size': 1, 'snapshot_id': '8ee68dda-5fdc-44eb-9682-b148127c1ed9'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb48aa8c-247b-44cf-9482-165075d38d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[981acd3f-094b-4577-9ac2-f94e474fdd2d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:38 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Volume volume-8c23de6d-9637-4287-ae3a-14852064f8d0 (8c23de6d-9637-4287-ae3a-14852064f8d0): created successfully Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb48aa8c-247b-44cf-9482-165075d38d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Flow 'volume_create_manager' (e3093199-f916-4e8b-9cd5-52c08139679e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:38 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-be3e9bbf-0bf1-4378-9848-3fa609b167b4 tempest-VolumeDependencyTests-1184420919 None] Created volume successfully. Jul 24 15:59:38 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35dd922b-a87b-40a0-8c7c-998e1b542027" returned: 0 in 0.275s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-35dd922b-a87b-40a0-8c7c-998e1b542027" released by "delete_volume" :: held 0.697s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:38 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d Jul 24 15:59:38 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created reservations ['5f24a474-021d-4c6f-8e1b-126348a8a4d7', 'f3ddf49f-afd6-485f-8f20-10b020c9f5ee', 'ce0a4145-5507-415f-a62d-07c0bfa20cbb', '5129a1ad-3ba3-4d46-a869-68589f648ef4'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:38 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:38 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:38 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d" returned: 0 in 0.389s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:38 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 1G Jul 24 15:59:38 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:38 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.258s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:38 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Deleted volume successfully. Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-b656122e-91f8-476a-b000-5bfecc18eefb-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a5b110a4-c6e4-47e7-a9fc-8ecece8c7082 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-35dd922b-a87b-40a0-8c7c-998e1b542027-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-b656122e-91f8-476a-b000-5bfecc18eefb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-quobyte-b656122e-91f8-476a-b000-5bfecc18eefb" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-b656122e-91f8-476a-b000-5bfecc18eefb" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e793522-cd19-4337-a3b7-ea76f0782348]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:39 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb Jul 24 15:59:39 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:39 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 1G" returned: 0 in 0.490s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef247db6-f01d-4cf6-9cda-540873b8e83d -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-8ee68dda-5fdc-44eb-9682-b148127c1ed9-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:39 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef247db6-f01d-4cf6-9cda-540873b8e83d -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 Jul 24 15:59:39 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-8ee68dda-5fdc-44eb-9682-b148127c1ed9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-quobyte-1cdb7a29-040a-4611-be19-5f55bd6059b0" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-1cdb7a29-040a-4611-be19-5f55bd6059b0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-quobyte-8ee68dda-5fdc-44eb-9682-b148127c1ed9" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-8ee68dda-5fdc-44eb-9682-b148127c1ed9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Deleting offline snapshot 8ee68dda-5fdc-44eb-9682-b148127c1ed9 of volume 1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] snapshot_file for this snap is: volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c853794-636a-4a95-8c53-f1d67a277213]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:39 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb" returned: 0 in 0.380s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:39 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb Jul 24 15:59:39 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:39 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 Jul 24 15:59:39 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:39 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef247db6-f01d-4cf6-9cda-540873b8e83d -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05" returned: 0 in 0.368s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:39 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 is being set with open permissions: ugo+rw Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:39 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 Jul 24 15:59:39 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:39 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b656122e-91f8-476a-b000-5bfecc18eefb" returned: 0 in 0.263s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-b656122e-91f8-476a-b000-5bfecc18eefb" released by "delete_volume" :: held 0.697s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created reservations ['64991e46-2bc9-435c-92c7-0be9582f71d6', 'edff2985-7d50-49aa-9bdb-30b6149fb95e', 'c2a9c69e-ac3f-42f9-a23a-de6bf713a0a9', '42db7c9e-4df1-4516-84de-d7c176333be1'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:39 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9" returned: 0 in 0.412s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cdb7a29-040a-4611-be19-5f55bd6059b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa54164-6a1a-476f-b9ee-7202d2604846]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:39 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:39 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:39 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05" returned: 0 in 0.286s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:39 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 Jul 24 15:59:39 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:39 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.info Jul 24 15:59:39 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-0473e948-2a51-4467-934e-47250f8c338a-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-0473e948-2a51-4467-934e-47250f8c338a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-quobyte-0473e948-2a51-4467-934e-47250f8c338a" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-0473e948-2a51-4467-934e-47250f8c338a" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:40 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.358s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:40 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Deleted volume successfully. Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6703a4e-827b-4fc2-ba6f-33168e6ed0e8]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:40 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.info" returned: 0 in 0.311s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:40 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.info is being set with open permissions: ugo+rw Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-2b92e3d7-6bea-4b04-8d68-0757470b0b3a tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-b656122e-91f8-476a-b000-5bfecc18eefb-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:40 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.info Jul 24 15:59:40 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:40 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0" returned: 0 in 0.479s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:40 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 Jul 24 15:59:40 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:40 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a Jul 24 15:59:40 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:40 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.info" returned: 0 in 0.287s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.429s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1587595346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36afedc6-5542-483e-8187-5843447af50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:33Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Creating volume 36afedc6-5542-483e-8187-5843447af50b {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:40 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:40 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b 1073741824 Jul 24 15:59:40 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:40 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a" returned: 0 in 0.411s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:40 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a Jul 24 15:59:40 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:40 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e053fbdd-ce7f-4d17-aa25-edc157ba8309 tempest-CinderUnicodeTest-1366964241 None] Create snapshot completed successfully Jul 24 15:59:40 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9" returned: 0 in 0.429s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:40 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9 Jul 24 15:59:40 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:40 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-0473e948-2a51-4467-934e-47250f8c338a" returned: 0 in 0.273s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-0473e948-2a51-4467-934e-47250f8c338a" released by "delete_volume" :: held 0.734s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:40 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0.8ee68dda-5fdc-44eb-9682-b148127c1ed9" returned: 0 in 0.268s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created reservations ['beaa4b6b-7df4-415a-9e25-b7cb7b57efdb', '49be0146-7449-45f7-b190-4044efc6c1ef', 'aeaefde8-5b80-4ad4-a372-8ac43917cb93', 'ad75e2c9-d867-4f96-9d68-83ff01173781'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-8ee68dda-5fdc-44eb-9682-b148127c1ed9" released by "_delete_snapshot" :: held 1.698s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-1cdb7a29-040a-4611-be19-5f55bd6059b0" released by "delete_snapshot" :: held 1.734s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:41 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b 1073741824" returned: 0 in 0.497s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:41 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:41 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:41 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b Jul 24 15:59:41 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Created reservations ['63dc1476-926e-4621-9e6d-d24ab6c72cd0', '87a3ca88-83a5-44d3-889b-41bf3aa225d9', '6c37ae21-866e-47f0-a841-70d44b7ce40f', 'f43f87a1-c70e-4560-a6c1-d44a9c96bbb1'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Delete snapshot completed successfully. Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-72485056-2e2a-45ae-a9c2-201465420077 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-8ee68dda-5fdc-44eb-9682-b148127c1ed9-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-cc0f4af5-29e3-42bc-a941-38d5d9720d1c-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-cc0f4af5-29e3-42bc-a941-38d5d9720d1c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "cinder-quobyte-cc0f4af5-29e3-42bc-a941-38d5d9720d1c" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-cc0f4af5-29e3-42bc-a941-38d5d9720d1c" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ef198e-b0f2-4d4f-a59c-76ad43f22ebe]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:41 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.345s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Deleted volume successfully. Jul 24 15:59:41 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-1cdb7a29-040a-4611-be19-5f55bd6059b0-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b" returned: 0 in 0.368s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "cinder-4380a474-5377-415f-8339-f179e6dc4d05-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66840316-0804-4556-a900-0a8922fe91c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36afedc6-5542-483e-8187-5843447af50b', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c55091-c021-4319-a99d-7b975ec80133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-0cb66b52-ac42-45c1-a670-87a45c7b8ed8 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-0473e948-2a51-4467-934e-47250f8c338a-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-1cdb7a29-040a-4611-be19-5f55bd6059b0-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:41 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Volume volume-36afedc6-5542-483e-8187-5843447af50b (36afedc6-5542-483e-8187-5843447af50b): created successfully Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c55091-c021-4319-a99d-7b975ec80133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (5e5d6cab-5fa1-46cd-9d78-7fc16bfb4485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:41 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c Jul 24 15:59:41 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-4380a474-5377-415f-8339-f179e6dc4d05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "cinder-quobyte-ef247db6-f01d-4cf6-9cda-540873b8e83d" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b973dc83-6918-484d-b7d1-1a9f3bfe47f0 tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-quobyte-ef247db6-f01d-4cf6-9cda-540873b8e83d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "cinder-quobyte-4380a474-5377-415f-8339-f179e6dc4d05" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-quobyte-1cdb7a29-040a-4611-be19-5f55bd6059b0" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-quobyte-4380a474-5377-415f-8339-f179e6dc4d05" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Deleting offline snapshot 4380a474-5377-415f-8339-f179e6dc4d05 of volume ef247db6-f01d-4cf6-9cda-540873b8e83d {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] snapshot_file for this snap is: volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-1cdb7a29-040a-4611-be19-5f55bd6059b0" acquired by "delete_volume" :: waited 0.043s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a30e4d3-e43d-408f-90f1-75d313788d11]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[40179479-e6a4-4901-874f-1c93ee045a8e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:41 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 Jul 24 15:59:41 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:41 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:41 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 Jul 24 15:59:41 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c" returned: 0 in 0.431s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:41 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c Jul 24 15:59:41 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:42 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05" returned: 0 in 0.433s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:42 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef247db6-f01d-4cf6-9cda-540873b8e83d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:59:42 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-cc0f4af5-29e3-42bc-a941-38d5d9720d1c" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0" returned: 0 in 0.439s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fa4182-ecbd-42b3-b326-20c9067095dd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-quobyte-cc0f4af5-29e3-42bc-a941-38d5d9720d1c" released by "delete_volume" :: held 0.811s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:42 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0 Jul 24 15:59:42 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Created reservations ['717d3e98-1907-43cf-9013-a8d61274ecc8', '55671355-525b-4277-b366-938186dec939', '33491162-5416-4f9b-9bc6-c3c9ff037cb3', '5178264b-9d29-4522-86aa-8e651da89dc7'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:42 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d Jul 24 15:59:42 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:42 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:42 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:42 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1cdb7a29-040a-4611-be19-5f55bd6059b0" returned: 0 in 0.334s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot 445f5500-df62-4644-a263-0860032b1f90 of volume 36afedc6-5542-483e-8187-5843447af50b {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-1cdb7a29-040a-4611-be19-5f55bd6059b0" released by "delete_volume" :: held 0.935s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e0e5e-5caa-4ee8-8185-b049cba71033]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Created reservations ['58c1a17a-23ad-4cc1-b923-f6663af3d854', 'b40b043a-c81d-44d4-b49a-3ed975d4dc31', '01eebbe7-2234-491e-a749-09b9ca641281', 'd7241073-242e-4898-a5e4-9e35922006e0'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:42 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b Jul 24 15:59:42 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:42 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:42 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:42 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:42 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.430s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d" returned: 0 in 0.645s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Deleted volume successfully. Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-249986df-3582-4378-82e4-526c63667a46 tempest-CreateVolumesFromSourceVolumeTest-1232856919 None] Lock "cinder-cc0f4af5-29e3-42bc-a941-38d5d9720d1c-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:42 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 Jul 24 15:59:42 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:43 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.318s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:43 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Deleted volume successfully. Jul 24 15:59:43 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b" returned: 0 in 0.471s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-741b077b-3ce4-4af4-956c-eccee2d12067 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-1cdb7a29-040a-4611-be19-5f55bd6059b0-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:43 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 1G Jul 24 15:59:43 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:43 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05" returned: 0 in 0.430s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:43 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05 Jul 24 15:59:43 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:43 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d.4380a474-5377-415f-8339-f179e6dc4d05" returned: 0 in 0.293s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:43 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 1G" returned: 0 in 0.504s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36afedc6-5542-483e-8187-5843447af50b -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-quobyte-4380a474-5377-415f-8339-f179e6dc4d05" released by "_delete_snapshot" :: held 1.986s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-quobyte-ef247db6-f01d-4cf6-9cda-540873b8e83d" released by "delete_snapshot" :: held 2.023s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:43 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36afedc6-5542-483e-8187-5843447af50b -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 Jul 24 15:59:43 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Created reservations ['40041fcb-41ca-4d8c-91ce-c884f777a86d', '1dc2cb62-708a-471c-abad-da06606ad876', '292da825-a748-4b96-91d9-f34aef207bed', '313a8252-9cca-46b9-abd1-9522f0453df1'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-8c23de6d-9637-4287-ae3a-14852064f8d0-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-8c23de6d-9637-4287-ae3a-14852064f8d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:43 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Delete snapshot completed successfully. Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-afa18fe1-818d-4218-a5c5-26c6ecdab648 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-4380a474-5377-415f-8339-f179e6dc4d05-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "cinder-quobyte-8c23de6d-9637-4287-ae3a-14852064f8d0" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-8c23de6d-9637-4287-ae3a-14852064f8d0" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c76da0c-b9ff-482a-8f78-d8594587b062]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:44 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36afedc6-5542-483e-8187-5843447af50b -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90" returned: 0 in 0.410s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:44 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 is being set with open permissions: ugo+rw Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:44 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 Jul 24 15:59:44 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:44 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 Jul 24 15:59:44 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:44 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90" returned: 0 in 0.264s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:44 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0" returned: 0 in 0.409s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:44 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.info Jul 24 15:59:44 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:44 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0 Jul 24 15:59:44 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:44 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.info" returned: 0 in 0.260s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:44 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.info is being set with open permissions: ugo+rw Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:44 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.info Jul 24 15:59:44 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:44 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-8c23de6d-9637-4287-ae3a-14852064f8d0" returned: 0 in 0.280s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-quobyte-8c23de6d-9637-4287-ae3a-14852064f8d0" released by "delete_volume" :: held 0.756s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Created reservations ['660b26d0-a87d-485b-817d-820742d4b1c9', 'd661e266-9a10-487c-b459-6efc818777fd', '628b7105-c30f-4011-b4fd-12333e0925b7', 'c2cf2fd1-9016-414d-b205-04c7729e8a96'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "cinder-ef247db6-f01d-4cf6-9cda-540873b8e83d-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-ef247db6-f01d-4cf6-9cda-540873b8e83d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:44 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:44 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "cinder-quobyte-ef247db6-f01d-4cf6-9cda-540873b8e83d" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:44 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-quobyte-ef247db6-f01d-4cf6-9cda-540873b8e83d" acquired by "delete_volume" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:45 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.info" returned: 0 in 0.395s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c98fa-ac91-4040-8e90-8e32e60b3e8e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-fc62bb24-5113-48b5-b46f-aea4a46a2a4c tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 15:59:45 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:45 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.374s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:45 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:45 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Deleted volume successfully. Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c4377a31-2b75-4805-9b80-7f263ca0d404 tempest-VolumeDependencyTests-1184420919 None] Lock "cinder-8c23de6d-9637-4287-ae3a-14852064f8d0-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:45 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d" returned: 0 in 0.489s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:45 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d Jul 24 15:59:45 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-445f5500-df62-4644-a263-0860032b1f90-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-445f5500-df62-4644-a263-0860032b1f90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-36afedc6-5542-483e-8187-5843447af50b" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-36afedc6-5542-483e-8187-5843447af50b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-445f5500-df62-4644-a263-0860032b1f90" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-445f5500-df62-4644-a263-0860032b1f90" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot 445f5500-df62-4644-a263-0860032b1f90 of volume 36afedc6-5542-483e-8187-5843447af50b {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b9720-215c-402b-9ef0-1913f7cc4d6f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:45 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ef247db6-f01d-4cf6-9cda-540873b8e83d" returned: 0 in 0.336s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:45 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-quobyte-ef247db6-f01d-4cf6-9cda-540873b8e83d" released by "delete_volume" :: held 0.955s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:46 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 Jul 24 15:59:46 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Created reservations ['abf9a2a1-fb61-4820-8651-110562b64482', '3aa7fd78-e675-43db-a77a-3034fe9c4052', 'd6b4b130-d632-4338-ab4e-3e4ffaf93686', '4b66100e-eefc-4377-a7df-cd504bfbee7e'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:46 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:46 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:46 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90" returned: 0 in 0.547s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36afedc6-5542-483e-8187-5843447af50b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0e8a39-5459-4405-896f-a70a0355a953]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:46 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.327s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:46 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Deleted volume successfully. Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-caf17abb-275a-4cd4-8b63-d0e1192ef0dd tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-ef247db6-f01d-4cf6-9cda-540873b8e83d-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:46 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b Jul 24 15:59:46 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:46 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b" returned: 0 in 0.437s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:46 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 Jul 24 15:59:46 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "cinder-ba1ff432-051e-47b4-9175-1aa4411b6913-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-ba1ff432-051e-47b4-9175-1aa4411b6913-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "cinder-quobyte-ba1ff432-051e-47b4-9175-1aa4411b6913" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-quobyte-ba1ff432-051e-47b4-9175-1aa4411b6913" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513a2dd-43df-40f2-a869-de22ad667e33]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:47 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90" returned: 0 in 0.455s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:47 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90 Jul 24 15:59:47 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:47 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 Jul 24 15:59:47 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:47 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b.445f5500-df62-4644-a263-0860032b1f90" returned: 0 in 0.283s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-445f5500-df62-4644-a263-0860032b1f90" released by "_delete_snapshot" :: held 1.878s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-36afedc6-5542-483e-8187-5843447af50b" released by "delete_snapshot" :: held 1.909s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:47 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Created reservations ['9ef0d6de-8ccf-46cd-b636-a81358db0288', '1833d36f-415c-4cd2-9d9f-8188e04d0aa7', 'c37f7a36-11e5-4fbb-be33-99aebe7e11b3', 'e0fb5e90-9bd3-48b4-b5e7-b29fb6c5d96d'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913" returned: 0 in 0.456s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:47 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913 Jul 24 15:59:47 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:47 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7c1b5be6-7246-4e60-a0c5-63176a3eba68 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-445f5500-df62-4644-a263-0860032b1f90-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-36afedc6-5542-483e-8187-5843447af50b-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-36afedc6-5542-483e-8187-5843447af50b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:48 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-ba1ff432-051e-47b4-9175-1aa4411b6913" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-36afedc6-5542-483e-8187-5843447af50b" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-quobyte-ba1ff432-051e-47b4-9175-1aa4411b6913" released by "delete_volume" :: held 0.811s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-36afedc6-5542-483e-8187-5843447af50b" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55b7173-c388-4427-b0a0-571ec0b324a0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Created reservations ['be70c796-7dfd-4952-bb53-39302ade9620', 'f31485d7-442c-4b30-b130-a524c0f982a4', 'f1377706-ba9d-4b20-baa0-87e8c0f45948', 'f7f9eec6-bc8e-4049-a6da-7b60507d3b12'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:48 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b Jul 24 15:59:48 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:48 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:48 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:48 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.268s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:48 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Deleted volume successfully. Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-87eb65b5-2eec-48e8-82fc-fec317dbbb81 tempest-CinderUnicodeTest-1366964241 None] Lock "cinder-ba1ff432-051e-47b4-9175-1aa4411b6913-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:48 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b" returned: 0 in 0.479s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:48 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b Jul 24 15:59:48 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:48 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-36afedc6-5542-483e-8187-5843447af50b" returned: 0 in 0.283s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:48 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-36afedc6-5542-483e-8187-5843447af50b" released by "delete_volume" :: held 0.849s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Created reservations ['3c15970b-11f8-4749-8691-9ee3b230b48a', 'e210b2f6-8a0f-42c4-9554-2d6130abb085', 'a790f090-5f20-46b3-8136-024169e98ebd', '18eeeca2-b0c9-46e5-b250-f4d087b473e2'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:49 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:49 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:49 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.327s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-7877e8c4-a95a-465e-95e3-b9acda25f924 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-36afedc6-5542-483e-8187-5843447af50b-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (67c7454a-df42-418d-a93b-257e97fbe84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e150430-d3f7-4bc8-b0ff-c4eb2935cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e150430-d3f7-4bc8-b0ff-c4eb2935cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503339227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c90a3d-5e23-4737-aa0c-bb0c8d7dae42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:50Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53dc4a3-97ff-450e-b3e3-378c99c028c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53dc4a3-97ff-450e-b3e3-378c99c028c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0701bc66-1fea-4322-b80d-f7afa1026f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0701bc66-1fea-4322-b80d-f7afa1026f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c90a3d-5e23-4737-aa0c-bb0c8d7dae42', 'volume_name': 'volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a29c52b-aebc-4b16-87b9-df5d484acc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a29c52b-aebc-4b16-87b9-df5d484acc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d6384f-e309-46ee-ab67-04bf010d9a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:49 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Volume 11c90a3d-5e23-4737-aa0c-bb0c8d7dae42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42', 'volume_size': 1} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503339227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c90a3d-5e23-4737-aa0c-bb0c8d7dae42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:50Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Creating volume 11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:49 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:49 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 1073741824 Jul 24 15:59:49 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e892e7b7-c202-4e55-bd35-30487d9a0e0f tempest-ProjectAdminTests-430936507 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88251) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 15:59:50 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 1073741824" returned: 0 in 0.543s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:50 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 Jul 24 15:59:50 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:50 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" returned: 0 in 0.275s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=237,cinder:UPDATE=284,cinder:DELETE=28,cinder:INSERT=74 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d6384f-e309-46ee-ab67-04bf010d9a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfb37b6-49fb-4a86-9bc0-4e185252ee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:50 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Volume volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 (11c90a3d-5e23-4737-aa0c-bb0c8d7dae42): created successfully Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfb37b6-49fb-4a86-9bc0-4e185252ee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:50 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (67c7454a-df42-418d-a93b-257e97fbe84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-918ffa54-6045-4595-8b03-f32de9447584 tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 15:59:52 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=201,cinder:UPDATE=311,cinder:INSERT=85,cinder:DELETE=24 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:59:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot 48882741-a543-4d86-8553-fbd02d345122 of volume 11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:59:52 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d5d59b-a145-4bde-aeba-f4c577ca3587]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:52 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 Jul 24 15:59:52 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:52 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" returned: 0 in 0.386s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:52 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 1G Jul 24 15:59:52 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:53 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 1G" returned: 0 in 0.531s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:53 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 Jul 24 15:59:53 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:53 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122" returned: 0 in 0.438s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:53 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 is being set with open permissions: ugo+rw Jul 24 15:59:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:53 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 Jul 24 15:59:53 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:53 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122" returned: 0 in 0.285s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:54 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.info Jul 24 15:59:54 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (0eb248ff-70d2-469a-b7dc-139647bd0d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88f879f-dabe-45e6-9c9b-dea85470f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88f879f-dabe-45e6-9c9b-dea85470f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-970379638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645466c7-f16e-4e4f-931c-403c81778342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:54Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad83cd09-2d55-471d-bd36-9105e4321cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad83cd09-2d55-471d-bd36-9105e4321cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e6b913-f3f3-4ac2-a6a5-b6a57a7bbda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e6b913-f3f3-4ac2-a6a5-b6a57a7bbda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645466c7-f16e-4e4f-931c-403c81778342', 'volume_name': 'volume-645466c7-f16e-4e4f-931c-403c81778342', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273b3fe4-66d2-4088-b81a-141970d072b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273b3fe4-66d2-4088-b81a-141970d072b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f6f84b-f358-43f4-af2c-1d106eee1090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:54 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Volume 645466c7-f16e-4e4f-931c-403c81778342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645466c7-f16e-4e4f-931c-403c81778342', 'volume_size': 1} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:54 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.info" returned: 0 in 0.283s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:54 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.info is being set with open permissions: ugo+rw Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:54 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.info Jul 24 15:59:54 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:54 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.info" returned: 0 in 0.245s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-970379638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645466c7-f16e-4e4f-931c-403c81778342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:54Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Creating volume 645466c7-f16e-4e4f-931c-403c81778342 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:54 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:54 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 1073741824 Jul 24 15:59:54 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:54 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-9a840271-ab4e-4baa-8aea-dc36f455d51e tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-48882741-a543-4d86-8553-fbd02d345122-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Lock "cinder-48882741-a543-4d86-8553-fbd02d345122-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-48882741-a543-4d86-8553-fbd02d345122" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-48882741-a543-4d86-8553-fbd02d345122" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot 48882741-a543-4d86-8553-fbd02d345122 of volume 11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5fe803-ddda-4d5b-adfb-8d3fd7c3f0e7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:54 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 Jul 24 15:59:54 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:55 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 1073741824" returned: 0 in 0.505s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:55 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 Jul 24 15:59:55 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:55 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122" returned: 0 in 0.501s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3639f0-cba5-4531-8cb2-af5bac081acd]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:55 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f6f84b-f358-43f4-af2c-1d106eee1090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645466c7-f16e-4e4f-931c-403c81778342', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8b9aaa-ae79-49df-8260-3973e6bd2dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:55 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Volume volume-645466c7-f16e-4e4f-931c-403c81778342 (645466c7-f16e-4e4f-931c-403c81778342): created successfully Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8b9aaa-ae79-49df-8260-3973e6bd2dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (0eb248ff-70d2-469a-b7dc-139647bd0d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ff9c4997-cbfa-4e85-b808-fbf336e7c85b tempest-ProjectReaderTests-1356326473 None] Created volume successfully. Jul 24 15:59:55 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 Jul 24 15:59:55 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:55 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" returned: 0 in 0.390s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:55 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 Jul 24 15:59:55 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:56 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122" returned: 0 in 0.518s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Creating offline snapshot ebfd3fb0-58a4-45d7-9277-696d43d5bf5a of volume 645466c7-f16e-4e4f-931c-403c81778342 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:59:56 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122 Jul 24 15:59:56 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ce66f0-0369-45b1-b7b5-ca117da9cbd7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:56 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 Jul 24 15:59:56 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:56 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42.48882741-a543-4d86-8553-fbd02d345122" returned: 0 in 0.282s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-48882741-a543-4d86-8553-fbd02d345122" released by "_delete_snapshot" :: held 1.825s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" released by "delete_snapshot" :: held 1.850s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Created reservations ['50d28cba-abc3-4a85-b390-614e87de408f', '868069ec-4de2-42f1-9772-b5cca0f1214e', '709fe40a-fc31-4da1-8739-7cb8580f7a6f', 'a6befb0d-f8b7-4e6f-9e94-6e5dfc1a7d2b'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:56 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342" returned: 0 in 0.404s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:56 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 15:59:56 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a 1G Jul 24 15:59:56 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b55c0aad-72ea-4ad8-bc7b-104e70a2a5da tempest-ProjectMemberTests-1287344200 None] Lock "cinder-48882741-a543-4d86-8553-fbd02d345122-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:56 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ac314f-274c-4a22-9889-f82b1399803a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:57 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 Jul 24 15:59:57 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:57 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a 1G" returned: 0 in 0.553s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645466c7-f16e-4e4f-931c-403c81778342 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:57 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645466c7-f16e-4e4f-931c-403c81778342 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a Jul 24 15:59:57 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:57 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" returned: 0 in 0.517s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:57 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42 Jul 24 15:59:57 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:57 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645466c7-f16e-4e4f-931c-403c81778342 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a" returned: 0 in 0.393s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:57 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a is being set with open permissions: ugo+rw Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:57 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a Jul 24 15:59:57 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:57 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" returned: 0 in 0.319s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42" released by "delete_volume" :: held 0.930s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:57 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a" returned: 0 in 0.328s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Created reservations ['10138b5c-b6b6-4ac2-a4c9-3b54f52e88ef', '60eb2d95-657f-4c1b-ade3-2f20ef066936', 'e92ce241-e0cc-4b20-9c00-bfd6c3e6bee0', 'c452bda1-4be2-4730-8fe1-ef558810fb8e'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:58 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.info Jul 24 15:59:58 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:58 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 15:59:58 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:58 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.info" returned: 0 in 0.364s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:58 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.info is being set with open permissions: ugo+rw Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:58 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.info Jul 24 15:59:58 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:58 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.288s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-8b6460ea-5daa-40b1-b393-70f1f8028353 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-11c90a3d-5e23-4737-aa0c-bb0c8d7dae42-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:58 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.info" returned: 0 in 0.295s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a521b763-d19d-49f0-807b-88b69b23dec1 tempest-ProjectReaderTests-1356326473 None] Create snapshot completed successfully Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (4917549e-1eaf-40da-a140-41b319b96604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704e7225-19e5-4380-b3b6-0e8b7b0573de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704e7225-19e5-4380-b3b6-0e8b7b0573de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217597172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f11cd01-23cb-4392-b932-4890371cad64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:00Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7736eeae-7fb7-4631-8f55-3df7f743ed48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7736eeae-7fb7-4631-8f55-3df7f743ed48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc15b744-9d22-4f72-96b1-130213b37f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc15b744-9d22-4f72-96b1-130213b37f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f11cd01-23cb-4392-b932-4890371cad64', 'volume_name': 'volume-1f11cd01-23cb-4392-b932-4890371cad64', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc424bd-93ef-4fe5-80c9-eef973ff3c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc424bd-93ef-4fe5-80c9-eef973ff3c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba88160-8b50-4934-b2d6-3ac20bc02e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Volume 1f11cd01-23cb-4392-b932-4890371cad64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f11cd01-23cb-4392-b932-4890371cad64', 'volume_size': 1} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217597172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f11cd01-23cb-4392-b932-4890371cad64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:00Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Creating volume 1f11cd01-23cb-4392-b932-4890371cad64 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:59 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-ebfd3fb0-58a4-45d7-9277-696d43d5bf5a-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:59 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 1073741824 Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Lock "cinder-ebfd3fb0-58a4-45d7-9277-696d43d5bf5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-645466c7-f16e-4e4f-931c-403c81778342" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:59 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-645466c7-f16e-4e4f-931c-403c81778342" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-ebfd3fb0-58a4-45d7-9277-696d43d5bf5a" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-ebfd3fb0-58a4-45d7-9277-696d43d5bf5a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Deleting offline snapshot ebfd3fb0-58a4-45d7-9277-696d43d5bf5a of volume 645466c7-f16e-4e4f-931c-403c81778342 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] snapshot_file for this snap is: volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6fc454-5a2e-4e43-bdac-d4a91d0f510d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:00 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a Jul 24 16:00:00 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:00 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 1073741824" returned: 0 in 0.564s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:00 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a" returned: 0 in 0.440s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645466c7-f16e-4e4f-931c-403c81778342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[83db9afc-629f-470e-8eb5-dfdfbcd0890d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:00 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 Jul 24 16:00:00 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:00 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 Jul 24 16:00:00 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:00 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64" returned: 0 in 0.315s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba88160-8b50-4934-b2d6-3ac20bc02e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f11cd01-23cb-4392-b932-4890371cad64', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac82ed36-8143-4094-ba24-3c6f5d7b5604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:00 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Volume volume-1f11cd01-23cb-4392-b932-4890371cad64 (1f11cd01-23cb-4392-b932-4890371cad64): created successfully Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac82ed36-8143-4094-ba24-3c6f5d7b5604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:00 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (4917549e-1eaf-40da-a140-41b319b96604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d88e57ef-0dbc-4f3f-9287-d0574397837c tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 16:00:01 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342" returned: 0 in 0.480s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:01 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a Jul 24 16:00:01 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:01 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a" returned: 0 in 0.390s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:01 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a Jul 24 16:00:01 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:01 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342.ebfd3fb0-58a4-45d7-9277-696d43d5bf5a" returned: 0 in 0.265s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-ebfd3fb0-58a4-45d7-9277-696d43d5bf5a" released by "_delete_snapshot" :: held 1.702s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-645466c7-f16e-4e4f-931c-403c81778342" released by "delete_snapshot" :: held 1.726s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Created reservations ['ddba8871-ef4a-44b8-81e2-2aed0e16cd96', '0a5c6174-1c3e-454f-9465-93df210f5adc', 'ac8f47d6-6c8f-418c-b187-46dbb299fd9d', '080ef950-f303-499a-abba-affdfc5d35ae'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:01 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Delete snapshot completed successfully. Jul 24 16:00:01 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f0db8327-31be-485a-99be-ee6f7192e42f tempest-ProjectReaderTests-1356326473 None] Lock "cinder-ebfd3fb0-58a4-45d7-9277-696d43d5bf5a-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 of volume 1f11cd01-23cb-4392-b932-4890371cad64 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad2788-de0b-463a-bf55-82cce724dae6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-645466c7-f16e-4e4f-931c-403c81778342-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-645466c7-f16e-4e4f-931c-403c81778342-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-645466c7-f16e-4e4f-931c-403c81778342" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-645466c7-f16e-4e4f-931c-403c81778342" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:02 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[544a33a1-7b42-4a98-b4a0-e0ffbd091ee3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:02 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:02 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 Jul 24 16:00:02 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Flow 'volume_create_manager' (c60bea39-66e7-4d9a-910a-2ec75c2f0f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72935b5c-5297-442e-ae71-fce2f08ddca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:02 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64" returned: 0 in 0.487s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72935b5c-5297-442e-ae71-fce2f08ddca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480254395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43124e4e-c6ef-4202-b5d1-a856bbc7c089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0b82f339a341658fa790b023141661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:02Z,use_quota=True,user_id='51d803f7b7884cc2ae3ccaf1b4957b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:02 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 1G Jul 24 16:00:02 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b0bd55-9883-43e5-8f64-cf448eaa8b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b0bd55-9883-43e5-8f64-cf448eaa8b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5712f6cf-3f94-4a4e-8c19-15820f2a7520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5712f6cf-3f94-4a4e-8c19-15820f2a7520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43124e4e-c6ef-4202-b5d1-a856bbc7c089', 'volume_name': 'volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18061a1d-1563-4d97-a807-c0435d5cdf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18061a1d-1563-4d97-a807-c0435d5cdf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbdba255-0ebe-4a7f-8b31-e2c74bf44d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:02 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Volume 43124e4e-c6ef-4202-b5d1-a856bbc7c089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089', 'volume_size': 1} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:02 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342" returned: 0 in 0.425s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:02 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:02 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342 Jul 24 16:00:02 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:03 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-645466c7-f16e-4e4f-931c-403c81778342" returned: 0 in 0.386s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-645466c7-f16e-4e4f-931c-403c81778342" released by "delete_volume" :: held 0.895s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:03 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 1G" returned: 0 in 0.576s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f11cd01-23cb-4392-b932-4890371cad64 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Created reservations ['868d1cf6-5e7f-49b4-a02c-d44dfc6aee9e', '0bd85de2-79ab-4fa1-9397-f7cf3f58dd9a', '83700a2f-6838-400b-8aea-930b8acf51f8', '3c08a4dd-48a4-447f-8511-15e9e5842363'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:03 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f11cd01-23cb-4392-b932-4890371cad64 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 Jul 24 16:00:03 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:03 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:03 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:03 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f11cd01-23cb-4392-b932-4890371cad64 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4" returned: 0 in 0.490s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:03 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 is being set with open permissions: ugo+rw Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:03 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:03 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 Jul 24 16:00:03 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.405s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:03 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Deleted volume successfully. Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-ed0db8e1-e285-4183-90b2-119290511997 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-645466c7-f16e-4e4f-931c-403c81778342-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:03 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4" returned: 0 in 0.294s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:03 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (bc7d240b-d46a-4036-a128-51c6b41639e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258f06c1-6d12-4d43-b0a8-8ffe767aacaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258f06c1-6d12-4d43-b0a8-8ffe767aacaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888124814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec9a161-b702-4e80-a3fb-d4fda53070dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:04Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:04 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.info Jul 24 16:00:04 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a593a73d-b4e4-4eda-9f02-861aa3db3fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a593a73d-b4e4-4eda-9f02-861aa3db3fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d275cb-92ec-4d01-841c-3f64cf8e881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d275cb-92ec-4d01-841c-3f64cf8e881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec9a161-b702-4e80-a3fb-d4fda53070dc', 'volume_name': 'volume-eec9a161-b702-4e80-a3fb-d4fda53070dc', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a20b08-ae19-440c-ba43-dea165d71012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a20b08-ae19-440c-ba43-dea165d71012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3dc96b-a5eb-46fc-8f58-a171b057ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:04 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Volume eec9a161-b702-4e80-a3fb-d4fda53070dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec9a161-b702-4e80-a3fb-d4fda53070dc', 'volume_size': 1} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:04 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.info" returned: 0 in 0.258s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:04 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.info is being set with open permissions: ugo+rw Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:04 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.info Jul 24 16:00:04 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:04 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.info" returned: 0 in 0.235s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480254395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43124e4e-c6ef-4202-b5d1-a856bbc7c089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0b82f339a341658fa790b023141661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:02Z,use_quota=True,user_id='51d803f7b7884cc2ae3ccaf1b4957b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Creating volume 43124e4e-c6ef-4202-b5d1-a856bbc7c089 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:04 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:04 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 1073741824 Jul 24 16:00:04 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:04 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-7d839acc-dc71-47c7-9dba-92a8aa843faa tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 16:00:04 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 1073741824" returned: 0 in 0.456s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:05 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 Jul 24 16:00:05 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-1f11cd01-23cb-4392-b932-4890371cad64" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-1f11cd01-23cb-4392-b932-4890371cad64" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:05 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089" returned: 0 in 0.277s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888124814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec9a161-b702-4e80-a3fb-d4fda53070dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:04Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Creating volume eec9a161-b702-4e80-a3fb-d4fda53070dc {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:05 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:05 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc 1073741824 Jul 24 16:00:05 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 of volume 1f11cd01-23cb-4392-b932-4890371cad64 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbdba255-0ebe-4a7f-8b31-e2c74bf44d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5449a333-4217-42bf-9d19-8189db8d35ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[444a3fa2-7be7-4975-a239-cddc188f9da1]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Volume volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 (43124e4e-c6ef-4202-b5d1-a856bbc7c089): created successfully Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5449a333-4217-42bf-9d19-8189db8d35ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Flow 'volume_create_manager' (c60bea39-66e7-4d9a-910a-2ec75c2f0f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-121b23ce-ef78-4c6b-a6c0-9cea0eedde46 tempest-ProjectReaderTests-230896993 None] Created volume successfully. Jul 24 16:00:05 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 Jul 24 16:00:05 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:05 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc 1073741824" returned: 0 in 0.488s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:05 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4" returned: 0 in 0.438s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f11cd01-23cb-4392-b932-4890371cad64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef4442-cc21-451b-ac13-30b5a2fdcce3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:05 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc Jul 24 16:00:05 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:05 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 Jul 24 16:00:05 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Acquiring lock "cinder-43124e4e-c6ef-4202-b5d1-a856bbc7c089-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Lock "cinder-43124e4e-c6ef-4202-b5d1-a856bbc7c089-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Acquiring lock "cinder-quobyte-43124e4e-c6ef-4202-b5d1-a856bbc7c089" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Lock "cinder-quobyte-43124e4e-c6ef-4202-b5d1-a856bbc7c089" acquired by "delete_volume" :: waited 0.028s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f64f07-8ac2-4902-a5cb-0b306033923d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:06 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc" returned: 0 in 0.332s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3dc96b-a5eb-46fc-8f58-a171b057ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec9a161-b702-4e80-a3fb-d4fda53070dc', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678c1aec-7769-40e8-bf6a-bef6ff9d2e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:06 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Volume volume-eec9a161-b702-4e80-a3fb-d4fda53070dc (eec9a161-b702-4e80-a3fb-d4fda53070dc): created successfully Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678c1aec-7769-40e8-bf6a-bef6ff9d2e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (bc7d240b-d46a-4036-a128-51c6b41639e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:06 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b931579b-d017-402f-bb80-0fc1ab762692 tempest-ProjectReaderTests-1356326473 None] Created volume successfully. Jul 24 16:00:06 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 Jul 24 16:00:06 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:06 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64" returned: 0 in 0.446s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:06 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 Jul 24 16:00:06 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:06 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089" returned: 0 in 0.377s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:06 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089 Jul 24 16:00:06 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:06 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4" returned: 0 in 0.379s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:06 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4 Jul 24 16:00:06 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:06 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-43124e4e-c6ef-4202-b5d1-a856bbc7c089" returned: 0 in 0.268s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Lock "cinder-quobyte-43124e4e-c6ef-4202-b5d1-a856bbc7c089" released by "delete_volume" :: held 0.706s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Created reservations ['902a4ede-a240-4d9e-b223-74beafea28b3', '75d88fdb-9883-45e9-a166-d66c345c95d7', '9c2e0f10-0b01-469e-96c8-e98d7ade0ace', '5f33ab55-f388-46e8-99ce-75c46b07a76e'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:06 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64.d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4" returned: 0 in 0.300s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:07 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:07 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4" released by "_delete_snapshot" :: held 1.695s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-1f11cd01-23cb-4392-b932-4890371cad64" released by "delete_snapshot" :: held 1.757s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Created reservations ['a2450267-9ac4-4d71-a2fc-f4402537c5ac', '0257e4db-abff-4b2d-bca6-2075e83989d5', 'b3f68080-7092-4723-9467-224d95926b2e', '7ee5463e-3eb2-4c20-9972-19f8a6f7f6ae'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:07 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f82be0dc-dec2-44da-a444-bdf0a06bd055 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-d28ecc3b-d8f0-4ad2-8d1f-711d5dc21ba4-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:07 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.322s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:07 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Deleted volume successfully. Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-93b248a9-d2f5-45c2-811d-0430e98d2713 tempest-ProjectReaderTests-230896993 None] Lock "cinder-43124e4e-c6ef-4202-b5d1-a856bbc7c089-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Creating offline snapshot c1e39424-c10b-4232-abfd-891935bf9c87 of volume eec9a161-b702-4e80-a3fb-d4fda53070dc {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-1f11cd01-23cb-4392-b932-4890371cad64-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9f383c-424c-4459-9214-5fb20e1a0cf2]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-1f11cd01-23cb-4392-b932-4890371cad64-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-1f11cd01-23cb-4392-b932-4890371cad64" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-1f11cd01-23cb-4392-b932-4890371cad64" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:07 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc Jul 24 16:00:07 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dddb6f-2f73-448e-bf9b-2f29cc118fb0]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:07 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 Jul 24 16:00:07 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Flow 'volume_create_manager' (be2978f5-b405-47d3-964f-9edfa24c225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b76511-6d50-468e-a3e3-ff4965ffe06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b76511-6d50-468e-a3e3-ff4965ffe06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-768138772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188e48a4-dabd-48d2-b755-8a59adee22f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0b82f339a341658fa790b023141661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:08Z,use_quota=True,user_id='51d803f7b7884cc2ae3ccaf1b4957b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeefe1e7-3dd9-48bb-bfd9-907bc1b06875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeefe1e7-3dd9-48bb-bfd9-907bc1b06875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ef5a7b-3e12-42e5-ad84-085ec5ba53d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:07 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ef5a7b-3e12-42e5-ad84-085ec5ba53d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188e48a4-dabd-48d2-b755-8a59adee22f2', 'volume_name': 'volume-188e48a4-dabd-48d2-b755-8a59adee22f2', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff234cc3-4281-4560-91f5-b86f494e0694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:07 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff234cc3-4281-4560-91f5-b86f494e0694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9319cb6-a6fe-4240-837e-f8c26a6c0e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:08 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Volume 188e48a4-dabd-48d2-b755-8a59adee22f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188e48a4-dabd-48d2-b755-8a59adee22f2', 'volume_size': 1} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc" returned: 0 in 0.520s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:08 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 1G Jul 24 16:00:08 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:08 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64" returned: 0 in 0.450s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:08 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64 Jul 24 16:00:08 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:08 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1f11cd01-23cb-4392-b932-4890371cad64" returned: 0 in 0.297s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-1f11cd01-23cb-4392-b932-4890371cad64" released by "delete_volume" :: held 0.830s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:08 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 1G" returned: 0 in 0.495s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec9a161-b702-4e80-a3fb-d4fda53070dc -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Created reservations ['a1ce6b02-5b83-4942-a687-62b579a684be', 'b7bb9dbc-c1f2-4a76-b9ff-4db2a2b418cd', 'c866607b-1337-48e4-bb20-3776a6cee47a', '0a73ddbe-022a-4a55-abce-dce79194957d'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:08 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec9a161-b702-4e80-a3fb-d4fda53070dc -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 Jul 24 16:00:08 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:08 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:08 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:08 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec9a161-b702-4e80-a3fb-d4fda53070dc -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87" returned: 0 in 0.340s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 is being set with open permissions: ugo+rw Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:08 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 Jul 24 16:00:08 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:08 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.353s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:08 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 16:00:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c96738a5-1148-4431-8520-da7d0b3e4653 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-1f11cd01-23cb-4392-b932-4890371cad64-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:09 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87" returned: 0 in 0.322s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:09 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.info Jul 24 16:00:09 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ce77c558-d5bb-4a2d-8cc0-f10057f5d54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad18f9c-d3ee-4c91-839e-267ca237bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad18f9c-d3ee-4c91-839e-267ca237bed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915601908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf466aea-66ee-4e46-be3d-2d32b9eac2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:09Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee78ae2-b054-4696-9105-18786d233e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee78ae2-b054-4696-9105-18786d233e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2e95fe-c05d-4c38-bf61-b1faf460f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2e95fe-c05d-4c38-bf61-b1faf460f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf466aea-66ee-4e46-be3d-2d32b9eac2ae', 'volume_name': 'volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379daa9b-b232-45a8-b4ee-5228377a8578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379daa9b-b232-45a8-b4ee-5228377a8578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10de205-7e8f-4f99-b77a-058fa53e5e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:09 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Volume bf466aea-66ee-4e46-be3d-2d32b9eac2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae', 'volume_size': 1} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:09 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.info" returned: 0 in 0.253s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:09 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.info is being set with open permissions: ugo+rw Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:09 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.info Jul 24 16:00:09 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:09 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.info" returned: 0 in 0.233s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-768138772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188e48a4-dabd-48d2-b755-8a59adee22f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0b82f339a341658fa790b023141661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:08Z,use_quota=True,user_id='51d803f7b7884cc2ae3ccaf1b4957b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Creating volume 188e48a4-dabd-48d2-b755-8a59adee22f2 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:09 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:09 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 1073741824 Jul 24 16:00:09 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-573108dc-fce2-4e31-85c2-bf64714618a1 tempest-ProjectReaderTests-1356326473 None] Create snapshot completed successfully Jul 24 16:00:10 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 1073741824" returned: 0 in 0.419s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:10 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 Jul 24 16:00:10 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:10 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2" returned: 0 in 0.238s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915601908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf466aea-66ee-4e46-be3d-2d32b9eac2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:09Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Creating volume bf466aea-66ee-4e46-be3d-2d32b9eac2ae {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:10 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9319cb6-a6fe-4240-837e-f8c26a6c0e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188e48a4-dabd-48d2-b755-8a59adee22f2', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3f0c60-0507-4fa3-b480-ec278f9a750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:10 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae 1073741824 Jul 24 16:00:10 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:10 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Volume volume-188e48a4-dabd-48d2-b755-8a59adee22f2 (188e48a4-dabd-48d2-b755-8a59adee22f2): created successfully Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3f0c60-0507-4fa3-b480-ec278f9a750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Flow 'volume_create_manager' (be2978f5-b405-47d3-964f-9edfa24c225a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:10 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8bf41bb1-8aae-4260-bd21-ddf5ac12dd30 tempest-ProjectReaderTests-230896993 None] Created volume successfully. Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-c1e39424-c10b-4232-abfd-891935bf9c87-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-c1e39424-c10b-4232-abfd-891935bf9c87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-eec9a161-b702-4e80-a3fb-d4fda53070dc" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-eec9a161-b702-4e80-a3fb-d4fda53070dc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-c1e39424-c10b-4232-abfd-891935bf9c87" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-c1e39424-c10b-4232-abfd-891935bf9c87" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Deleting offline snapshot c1e39424-c10b-4232-abfd-891935bf9c87 of volume eec9a161-b702-4e80-a3fb-d4fda53070dc {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] snapshot_file for this snap is: volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c7fff0-8c79-47ff-a327-f9032f30983d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:10 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 Jul 24 16:00:10 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:10 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae 1073741824" returned: 0 in 0.436s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:10 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae Jul 24 16:00:10 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:11 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87" returned: 0 in 0.369s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eec9a161-b702-4e80-a3fb-d4fda53070dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c764a4-796f-44f0-84e1-5ebb372b0a9a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:11 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" returned: 0 in 0.268s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Acquiring lock "cinder-188e48a4-dabd-48d2-b755-8a59adee22f2-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10de205-7e8f-4f99-b77a-058fa53e5e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbfff10-8dd7-44b5-9d53-75526b40cf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Lock "cinder-188e48a4-dabd-48d2-b755-8a59adee22f2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:11 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc Jul 24 16:00:11 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:11 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Volume volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae (bf466aea-66ee-4e46-be3d-2d32b9eac2ae): created successfully Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbfff10-8dd7-44b5-9d53-75526b40cf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ce77c558-d5bb-4a2d-8cc0-f10057f5d54a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:11 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3d2aa3d6-0bcf-4480-baf1-20c4ceb2fb33 tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Acquiring lock "cinder-quobyte-188e48a4-dabd-48d2-b755-8a59adee22f2" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Lock "cinder-quobyte-188e48a4-dabd-48d2-b755-8a59adee22f2" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9b3fc1-dacb-41a2-946a-e637d9f7df4a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:11 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 Jul 24 16:00:11 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:11 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc" returned: 0 in 0.481s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot 3bb88b78-9608-4308-91ae-cbf5f3c35ff2 of volume bf466aea-66ee-4e46-be3d-2d32b9eac2ae {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:11 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 Jul 24 16:00:11 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb24b0f-b02b-474c-8fd5-80e64884e3ac]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:11 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae Jul 24 16:00:11 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:11 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2" returned: 0 in 0.433s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:11 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2 Jul 24 16:00:11 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:11 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87" returned: 0 in 0.343s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:11 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87 Jul 24 16:00:11 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:12 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" returned: 0 in 0.406s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:12 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-188e48a4-dabd-48d2-b755-8a59adee22f2" returned: 0 in 0.279s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:12 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 1G Jul 24 16:00:12 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Lock "cinder-quobyte-188e48a4-dabd-48d2-b755-8a59adee22f2" released by "delete_volume" :: held 0.763s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Created reservations ['891ce33c-9b82-4bdf-af89-555550bbd43e', 'ea0e7a21-994b-4984-bef1-bcdf3e120ba9', '8141083d-0ebc-47de-87bc-f72178c76b0c', 'a83a4c1f-bc7b-4925-bd35-aab59ff54e18'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:12 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc.c1e39424-c10b-4232-abfd-891935bf9c87" returned: 0 in 0.279s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:12 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:12 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-c1e39424-c10b-4232-abfd-891935bf9c87" released by "_delete_snapshot" :: held 1.594s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-eec9a161-b702-4e80-a3fb-d4fda53070dc" released by "delete_snapshot" :: held 1.618s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Created reservations ['a282c323-3ea4-4b28-a816-04aac16b5403', '8f8d2370-e464-49f8-839f-b177e7140158', '955a5696-4e77-4e12-b833-ab863e1936e5', 'de47a4fb-5f02-41fd-95a6-52ec6806a829'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Delete snapshot completed successfully. Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a21041ef-1eb8-4991-8d21-31b6aec24734 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-c1e39424-c10b-4232-abfd-891935bf9c87-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:12 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.274s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:12 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Deleted volume successfully. Jul 24 16:00:12 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 1G" returned: 0 in 0.461s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-377e7f52-1acc-4c5b-a903-60866561ceb8 tempest-ProjectReaderTests-230896993 None] Lock "cinder-188e48a4-dabd-48d2-b755-8a59adee22f2-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:12 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 Jul 24 16:00:12 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-eec9a161-b702-4e80-a3fb-d4fda53070dc-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:12 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2" returned: 0 in 0.327s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:12 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 is being set with open permissions: ugo+rw Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-eec9a161-b702-4e80-a3fb-d4fda53070dc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:12 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 Jul 24 16:00:12 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-eec9a161-b702-4e80-a3fb-d4fda53070dc" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-eec9a161-b702-4e80-a3fb-d4fda53070dc" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4faf0a-1ca5-4336-960d-ab14372c3437]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:12 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc Jul 24 16:00:13 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:13 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2" returned: 0 in 0.291s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.info Jul 24 16:00:13 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Flow 'volume_create_manager' (2f8569b7-a026-40b8-ac6a-462f0592084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274f75af-1495-4c0c-b088-1818b5313667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274f75af-1495-4c0c-b088-1818b5313667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410851391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28090e1-399d-4e4e-8ad4-487d689113b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0b82f339a341658fa790b023141661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:13Z,use_quota=True,user_id='51d803f7b7884cc2ae3ccaf1b4957b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d21ec0-3c0e-46aa-bd04-3ffe9b0b232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d21ec0-3c0e-46aa-bd04-3ffe9b0b232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bbe153-1ded-4448-9737-0ebd62ae08d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bbe153-1ded-4448-9737-0ebd62ae08d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c28090e1-399d-4e4e-8ad4-487d689113b6', 'volume_name': 'volume-c28090e1-399d-4e4e-8ad4-487d689113b6', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fae934-60d7-4126-9dfd-3d95883b5a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fae934-60d7-4126-9dfd-3d95883b5a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ba6e49-5651-4a12-9722-a27cd1fc72f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Volume c28090e1-399d-4e4e-8ad4-487d689113b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c28090e1-399d-4e4e-8ad4-487d689113b6', 'volume_size': 1} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:13 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc" returned: 0 in 0.415s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc Jul 24 16:00:13 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:13 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.info" returned: 0 in 0.269s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:13 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.info is being set with open permissions: ugo+rw Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.info Jul 24 16:00:13 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:13 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-eec9a161-b702-4e80-a3fb-d4fda53070dc" returned: 0 in 0.260s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-eec9a161-b702-4e80-a3fb-d4fda53070dc" released by "delete_volume" :: held 0.748s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:13 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.info" returned: 0 in 0.254s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410851391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28090e1-399d-4e4e-8ad4-487d689113b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0b82f339a341658fa790b023141661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:13Z,use_quota=True,user_id='51d803f7b7884cc2ae3ccaf1b4957b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Creating volume c28090e1-399d-4e4e-8ad4-487d689113b6 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:13 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 1073741824 Jul 24 16:00:13 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Created reservations ['04b29f8a-53ea-42c1-8606-729fd8012ec4', 'be0fad0e-0e2a-422d-a7a9-522ccc2968ad', '1649dc3d-6f4f-4007-bfb2-ef472549ae8d', '093e5648-1b75-4153-beaa-559053f7c943'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:13 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-80057909-cbdc-46f0-8b55-a20f9e452d93 tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:13 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:13 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:14 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.291s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Deleted volume successfully. Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-c29f9ac3-7c4f-4747-9503-832c1adb8251 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-eec9a161-b702-4e80-a3fb-d4fda53070dc-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:14 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 1073741824" returned: 0 in 0.519s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:14 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 Jul 24 16:00:14 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (f13cb83f-b230-4698-88d4-b08c0332d1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921f9342-f179-4afe-8c57-e2948781a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921f9342-f179-4afe-8c57-e2948781a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066529293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35277369-f75a-4db6-b678-9ddbf4ecbf37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:14Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfe021b-fd81-47a2-b95c-93cfc59aafe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfe021b-fd81-47a2-b95c-93cfc59aafe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d2e558-4199-45db-9453-45d7cbe14c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d2e558-4199-45db-9453-45d7cbe14c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35277369-f75a-4db6-b678-9ddbf4ecbf37', 'volume_name': 'volume-35277369-f75a-4db6-b678-9ddbf4ecbf37', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e76ac0-ea71-43f6-b9e6-444543a8966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e76ac0-ea71-43f6-b9e6-444543a8966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6212c3-4cc6-4dae-9e96-8a2b72956a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Volume 35277369-f75a-4db6-b678-9ddbf4ecbf37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35277369-f75a-4db6-b678-9ddbf4ecbf37', 'volume_size': 1} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066529293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35277369-f75a-4db6-b678-9ddbf4ecbf37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:14Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Creating volume 35277369-f75a-4db6-b678-9ddbf4ecbf37 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:14 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:14 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 1073741824 Jul 24 16:00:14 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ba6e49-5651-4a12-9722-a27cd1fc72f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28090e1-399d-4e4e-8ad4-487d689113b6', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3a7f1d-6c99-42d9-b106-6762aa40cf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Volume volume-c28090e1-399d-4e4e-8ad4-487d689113b6 (c28090e1-399d-4e4e-8ad4-487d689113b6): created successfully Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3a7f1d-6c99-42d9-b106-6762aa40cf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Flow 'volume_create_manager' (2f8569b7-a026-40b8-ac6a-462f0592084c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:14 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6a4a14f5-02c7-468b-91ee-8533cabf6c98 tempest-ProjectReaderTests-230896993 None] Created volume successfully. Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-3bb88b78-9608-4308-91ae-cbf5f3c35ff2-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-3bb88b78-9608-4308-91ae-cbf5f3c35ff2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-3bb88b78-9608-4308-91ae-cbf5f3c35ff2" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-3bb88b78-9608-4308-91ae-cbf5f3c35ff2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot 3bb88b78-9608-4308-91ae-cbf5f3c35ff2 of volume bf466aea-66ee-4e46-be3d-2d32b9eac2ae {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3bbd77-1510-4634-bc52-c9b7d2e71cde]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:14 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:14 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 Jul 24 16:00:14 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:15 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 1073741824" returned: 0 in 0.457s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:15 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 Jul 24 16:00:15 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:15 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Acquiring lock "cinder-c28090e1-399d-4e4e-8ad4-487d689113b6-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2" returned: 0 in 0.414s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Lock "cinder-c28090e1-399d-4e4e-8ad4-487d689113b6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a3b754-7c09-4f37-9af1-889d1501533f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Acquiring lock "cinder-quobyte-c28090e1-399d-4e4e-8ad4-487d689113b6" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:15 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37" returned: 0 in 0.292s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Lock "cinder-quobyte-c28090e1-399d-4e4e-8ad4-487d689113b6" acquired by "delete_volume" :: waited 0.025s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6212c3-4cc6-4dae-9e96-8a2b72956a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35277369-f75a-4db6-b678-9ddbf4ecbf37', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e17fd7-92b2-4c1b-89af-f1594729ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[58522534-0da5-4328-954c-0aa9aab167f7]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:15 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Volume volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 (35277369-f75a-4db6-b678-9ddbf4ecbf37): created successfully Jul 24 16:00:15 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e17fd7-92b2-4c1b-89af-f1594729ea23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:15 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (f13cb83f-b230-4698-88d4-b08c0332d1a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:15 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-afe3a28b-41f5-4ede-bc30-a19ee4814054 tempest-ProjectReaderTests-1356326473 None] Created volume successfully. Jul 24 16:00:15 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 Jul 24 16:00:15 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:15 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" returned: 0 in 0.406s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:15 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 Jul 24 16:00:15 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:15 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6" returned: 0 in 0.374s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:15 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:15 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6 Jul 24 16:00:15 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:16 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:16 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-c28090e1-399d-4e4e-8ad4-487d689113b6" returned: 0 in 0.264s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Lock "cinder-quobyte-c28090e1-399d-4e4e-8ad4-487d689113b6" released by "delete_volume" :: held 0.700s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:16 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2 Jul 24 16:00:16 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Created reservations ['fc6645f8-408f-46bb-b30b-cc32e70b3fe2', '7aa79103-aef5-455b-95af-d09aeb5a3d9e', 'a31c7424-e62d-44ab-82ec-10331cc5297c', '77557254-2fe4-46a5-ab24-a6d8c1c1fd8d'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:16 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:16 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:16 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae.3bb88b78-9608-4308-91ae-cbf5f3c35ff2" returned: 0 in 0.251s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-3bb88b78-9608-4308-91ae-cbf5f3c35ff2" released by "_delete_snapshot" :: held 1.546s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" released by "delete_snapshot" :: held 1.571s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Created reservations ['05d8758a-a25b-4e84-8eaa-ead392b35d59', 'bed6e0f9-a95f-4093-9555-7bd80a4b1909', '395321a4-8582-4baf-b519-02169daeecda', 'bb5c9dbd-32e9-476a-9f1a-3ec043f995ee'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:16 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.270s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Deleted volume successfully. Jul 24 16:00:16 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-4e63aee6-d5db-4f1c-a1fa-47e0807cea46 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-3bb88b78-9608-4308-91ae-cbf5f3c35ff2-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-009f1585-61bd-43a3-afbc-d0c027ceab23 tempest-ProjectReaderTests-230896993 None] Lock "cinder-c28090e1-399d-4e4e-8ad4-487d689113b6-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Creating offline snapshot 6d591169-3cdc-4f5e-9e64-3a780b83f87e of volume 35277369-f75a-4db6-b678-9ddbf4ecbf37 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee57fc-1b3d-400d-97fe-1e1076dbdf68]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:16 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 Jul 24 16:00:16 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-bf466aea-66ee-4e46-be3d-2d32b9eac2ae-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Lock "cinder-bf466aea-66ee-4e46-be3d-2d32b9eac2ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Flow 'volume_create_manager' (7ed40cdb-6041-42c0-8c49-e5da3abeef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8c9a48-cf22-40d0-8829-88a144c29fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8c9a48-cf22-40d0-8829-88a144c29fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343768135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a55a7d4-c920-40a8-a62a-1a85585ce286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0b82f339a341658fa790b023141661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:17Z,use_quota=True,user_id='51d803f7b7884cc2ae3ccaf1b4957b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:16 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8c5d91-4bf8-42e0-95ad-19635668f31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8c5d91-4bf8-42e0-95ad-19635668f31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fe0f8e-e5ed-4880-ae41-15f47a8a5edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fe0f8e-e5ed-4880-ae41-15f47a8a5edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a55a7d4-c920-40a8-a62a-1a85585ce286', 'volume_name': 'volume-5a55a7d4-c920-40a8-a62a-1a85585ce286', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831a3aa3-cf81-458d-ae0b-5ab6fc37ce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831a3aa3-cf81-458d-ae0b-5ab6fc37ce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b5bab8-dcb0-4e78-8cc7-a2db149dd464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:17 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Volume 5a55a7d4-c920-40a8-a62a-1a85585ce286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a55a7d4-c920-40a8-a62a-1a85585ce286', 'volume_size': 1} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[95482390-1b2e-4bee-a851-64e11318cf0a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:17 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37" returned: 0 in 0.424s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:17 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e 1G Jul 24 16:00:17 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:17 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae Jul 24 16:00:17 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:17 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" returned: 0 in 0.353s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:17 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae Jul 24 16:00:17 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:17 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e 1G" returned: 0 in 0.410s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:17 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e Jul 24 16:00:17 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:17 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-bf466aea-66ee-4e46-be3d-2d32b9eac2ae" released by "delete_volume" :: held 0.669s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Created reservations ['fdf040dc-5cdf-400b-8682-f63353583f14', '60d43d6f-d89d-41a0-8f52-4329705e76d1', '3261a833-8e93-4b6a-bd67-20252a08d120', 'c0512d5b-4e05-472a-8677-cb1f9c309fa7'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:17 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:17 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:17 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e" returned: 0 in 0.318s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:17 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e is being set with open permissions: ugo+rw Jul 24 16:00:17 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:17 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e Jul 24 16:00:17 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:18 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.274s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 16:00:18 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e" returned: 0 in 0.272s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-00fe6f8c-a0c1-42f3-a16c-355a7a47d0db tempest-ProjectMemberTests-1287344200 None] Lock "cinder-bf466aea-66ee-4e46-be3d-2d32b9eac2ae-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:18 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.info Jul 24 16:00:18 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:18 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.info" returned: 0 in 0.279s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:18 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.info is being set with open permissions: ugo+rw Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:18 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.info Jul 24 16:00:18 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ef604698-8b64-4c16-b7b0-da9f999a0b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791e0ea4-a095-42a3-809b-740aa1bae9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791e0ea4-a095-42a3-809b-740aa1bae9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-219964368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c90f846-fcd7-46e7-bb78-cfc83f4e212e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:19Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfdc92b-fa34-4076-b38d-b2f131064b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfdc92b-fa34-4076-b38d-b2f131064b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f883d2a7-9d18-406b-9cca-8aa061ae1dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f883d2a7-9d18-406b-9cca-8aa061ae1dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c90f846-fcd7-46e7-bb78-cfc83f4e212e', 'volume_name': 'volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5eb1a1-2314-4483-9ae6-086b72f97ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5eb1a1-2314-4483-9ae6-086b72f97ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040b0be0-895d-4b04-8092-8ad1e5b74c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:18 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Volume 7c90f846-fcd7-46e7-bb78-cfc83f4e212e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e', 'volume_size': 1} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:18 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.info" returned: 0 in 0.245s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343768135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a55a7d4-c920-40a8-a62a-1a85585ce286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0b82f339a341658fa790b023141661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:17Z,use_quota=True,user_id='51d803f7b7884cc2ae3ccaf1b4957b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Creating volume 5a55a7d4-c920-40a8-a62a-1a85585ce286 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:18 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:18 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:18 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 1073741824 Jul 24 16:00:18 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:18 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-19c1cf77-acff-4bc8-8f63-fad6e6c23422 tempest-ProjectReaderTests-1356326473 None] Create snapshot completed successfully Jul 24 16:00:19 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 1073741824" returned: 0 in 0.438s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:19 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 Jul 24 16:00:19 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:19 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286" returned: 0 in 0.241s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-219964368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c90f846-fcd7-46e7-bb78-cfc83f4e212e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:19Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Creating volume 7c90f846-fcd7-46e7-bb78-cfc83f4e212e {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:19 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b5bab8-dcb0-4e78-8cc7-a2db149dd464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a55a7d4-c920-40a8-a62a-1a85585ce286', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:19 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e 1073741824 Jul 24 16:00:19 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68da131f-cd48-4073-910c-e2cd84f342cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:19 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Volume volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 (5a55a7d4-c920-40a8-a62a-1a85585ce286): created successfully Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68da131f-cd48-4073-910c-e2cd84f342cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Flow 'volume_create_manager' (7ed40cdb-6041-42c0-8c49-e5da3abeef0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:19 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-db289ad3-4b34-41ed-9c89-b38820c87358 tempest-ProjectReaderTests-230896993 None] Created volume successfully. Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-6d591169-3cdc-4f5e-9e64-3a780b83f87e-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:19 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e 1073741824" returned: 0 in 0.409s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-6d591169-3cdc-4f5e-9e64-3a780b83f87e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-35277369-f75a-4db6-b678-9ddbf4ecbf37" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-35277369-f75a-4db6-b678-9ddbf4ecbf37" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-6d591169-3cdc-4f5e-9e64-3a780b83f87e" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-6d591169-3cdc-4f5e-9e64-3a780b83f87e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Deleting offline snapshot 6d591169-3cdc-4f5e-9e64-3a780b83f87e of volume 35277369-f75a-4db6-b678-9ddbf4ecbf37 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] snapshot_file for this snap is: volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:19 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7389860b-e36c-4dd5-afe5-45c63d19993f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e Jul 24 16:00:20 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Acquiring lock "cinder-5a55a7d4-c920-40a8-a62a-1a85585ce286-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Lock "cinder-5a55a7d4-c920-40a8-a62a-1a85585ce286-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:20 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e Jul 24 16:00:20 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Acquiring lock "cinder-quobyte-5a55a7d4-c920-40a8-a62a-1a85585ce286" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Lock "cinder-quobyte-5a55a7d4-c920-40a8-a62a-1a85585ce286" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0d8397-af27-4817-b2dc-45919ac7b3c5]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" returned: 0 in 0.331s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040b0be0-895d-4b04-8092-8ad1e5b74c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:20 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 Jul 24 16:00:20 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c54a476-929f-44ad-8e75-c621e3183097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:20 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Volume volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e (7c90f846-fcd7-46e7-bb78-cfc83f4e212e): created successfully Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c54a476-929f-44ad-8e75-c621e3183097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ef604698-8b64-4c16-b7b0-da9f999a0b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:20 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-6c7ec5ec-7a3e-44e7-8c12-9a2f65be7ffb tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 16:00:20 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e" returned: 0 in 0.429s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35277369-f75a-4db6-b678-9ddbf4ecbf37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[027b073a-e201-496a-8144-0653b75863df]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 Jul 24 16:00:20 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286" returned: 0 in 0.377s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286 Jul 24 16:00:20 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot d2174d94-f422-4706-a9e6-2d4671693896 of volume 7c90f846-fcd7-46e7-bb78-cfc83f4e212e {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b0c2e5-88c7-4bcb-be60-530049858e37]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37" returned: 0 in 0.418s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-5a55a7d4-c920-40a8-a62a-1a85585ce286" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:20 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e Jul 24 16:00:20 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Lock "cinder-quobyte-5a55a7d4-c920-40a8-a62a-1a85585ce286" released by "delete_volume" :: held 0.725s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:20 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e Jul 24 16:00:20 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Created reservations ['e5127cd4-6eba-4b2e-b378-3f9d641f8b97', '94ca52ee-ba08-4104-9a1a-acfa99534888', '4f4d2812-c666-4961-a2bf-7d28c1df2910', 'b0df388b-ed46-47ce-a84d-e46a6ce52aa1'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:21 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:21 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:21 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e" returned: 0 in 0.376s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:21 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e Jul 24 16:00:21 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:21 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" returned: 0 in 0.427s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:21 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 1G Jul 24 16:00:21 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:21 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.272s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:21 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Deleted volume successfully. Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-e018521c-2c05-4367-8980-3d5128cdbd91 tempest-ProjectReaderTests-230896993 None] Lock "cinder-5a55a7d4-c920-40a8-a62a-1a85585ce286-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:21 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37.6d591169-3cdc-4f5e-9e64-3a780b83f87e" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-6d591169-3cdc-4f5e-9e64-3a780b83f87e" released by "_delete_snapshot" :: held 1.576s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-35277369-f75a-4db6-b678-9ddbf4ecbf37" released by "delete_snapshot" :: held 1.606s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Created reservations ['7f07d145-944f-4deb-95a5-46e9ead855ed', '4a1368af-b5b4-499a-8b1c-29f97133f283', '2fe74fe2-83e6-4a51-9b26-8b3ead26cc4e', 'b81ebda9-58f3-4f37-8a26-364047165b41'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:21 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Delete snapshot completed successfully. Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-260c7490-de39-4da1-b739-db833b7c2d68 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-6d591169-3cdc-4f5e-9e64-3a780b83f87e-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:21 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 1G" returned: 0 in 0.480s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:21 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 Jul 24 16:00:21 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-35277369-f75a-4db6-b678-9ddbf4ecbf37-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-35277369-f75a-4db6-b678-9ddbf4ecbf37-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:22 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896" returned: 0 in 0.357s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:22 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 is being set with open permissions: ugo+rw Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:22 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 Jul 24 16:00:22 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-35277369-f75a-4db6-b678-9ddbf4ecbf37" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-35277369-f75a-4db6-b678-9ddbf4ecbf37" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[844eb170-07d6-443c-a8fb-204363d776f6]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:22 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 Jul 24 16:00:22 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896" returned: 0 in 0.291s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:22 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.info Jul 24 16:00:22 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37" returned: 0 in 0.408s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:22 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37 Jul 24 16:00:22 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.info" returned: 0 in 0.283s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:22 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.info is being set with open permissions: ugo+rw Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:22 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.info Jul 24 16:00:22 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-35277369-f75a-4db6-b678-9ddbf4ecbf37" returned: 0 in 0.305s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:22 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-35277369-f75a-4db6-b678-9ddbf4ecbf37" released by "delete_volume" :: held 0.810s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:23 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.info" returned: 0 in 0.299s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Created reservations ['4c5431e2-fb48-4df3-8cef-6bad391fa399', '8aeba11a-1364-462a-a487-868807087ec9', '9217b9fe-1d51-429a-a333-13e6f70055c0', 'b9c0ba0f-6738-4591-af17-013e8f5fa3fb'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c2645161-f22c-45c6-b324-1d4bcdec142f tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:23 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:23 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:23 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.275s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:23 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Deleted volume successfully. Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-44679420-d022-4339-b799-c67e802f1b11 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-35277369-f75a-4db6-b678-9ddbf4ecbf37-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (c78eb41d-140c-4ade-a6b4-710a429a9f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee46976f-a155-46b7-b004-94dc962dd09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee46976f-a155-46b7-b004-94dc962dd09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-55916608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b315d8ce-a2f6-4cfe-867e-879b0e92be71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:24Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7042789-2e06-4586-9be2-dc921e07f940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7042789-2e06-4586-9be2-dc921e07f940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7af1287-d7ee-43b1-b44d-90083935de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7af1287-d7ee-43b1-b44d-90083935de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b315d8ce-a2f6-4cfe-867e-879b0e92be71', 'volume_name': 'volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce3adf1-b360-441d-8019-8055dc4eba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce3adf1-b360-441d-8019-8055dc4eba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c35b45f-a653-462b-974f-7a8c06c3beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:23 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Volume b315d8ce-a2f6-4cfe-867e-879b0e92be71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71', 'volume_size': 1} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-55916608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b315d8ce-a2f6-4cfe-867e-879b0e92be71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:24Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Creating volume b315d8ce-a2f6-4cfe-867e-879b0e92be71 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:23 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:23 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 1073741824 Jul 24 16:00:23 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-d2174d94-f422-4706-a9e6-2d4671693896-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-d2174d94-f422-4706-a9e6-2d4671693896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-d2174d94-f422-4706-a9e6-2d4671693896" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-d2174d94-f422-4706-a9e6-2d4671693896" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot d2174d94-f422-4706-a9e6-2d4671693896 of volume 7c90f846-fcd7-46e7-bb78-cfc83f4e212e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d4028c-0536-4c8a-a6cb-b98a77bb0920]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:24 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 Jul 24 16:00:24 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:24 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 1073741824" returned: 0 in 0.470s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:24 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 Jul 24 16:00:24 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:24 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896" returned: 0 in 0.369s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bc306d-5b52-4c66-b04f-2f2223a5492c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:24 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71" returned: 0 in 0.242s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c35b45f-a653-462b-974f-7a8c06c3beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb6b199-eedf-4b0c-ba12-10355ecc51e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:24 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Volume volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 (b315d8ce-a2f6-4cfe-867e-879b0e92be71): created successfully Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb6b199-eedf-4b0c-ba12-10355ecc51e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (c78eb41d-140c-4ade-a6b4-710a429a9f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-c792969a-8457-4db0-ab18-c706cdaf0a13 tempest-ProjectReaderTests-1356326473 None] Created volume successfully. Jul 24 16:00:24 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e Jul 24 16:00:24 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Creating offline snapshot 620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 of volume b315d8ce-a2f6-4cfe-867e-879b0e92be71 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6b5571-8167-45b2-b570-03b35b7ded54]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:24 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" returned: 0 in 0.401s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:24 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 Jul 24 16:00:24 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:25 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 Jul 24 16:00:25 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:25 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896" returned: 0 in 0.368s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:25 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71" returned: 0 in 0.392s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:25 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896 Jul 24 16:00:25 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:25 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 1G Jul 24 16:00:25 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:25 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e.d2174d94-f422-4706-a9e6-2d4671693896" returned: 0 in 0.261s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-d2174d94-f422-4706-a9e6-2d4671693896" released by "_delete_snapshot" :: held 1.491s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" released by "delete_snapshot" :: held 1.512s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Created reservations ['97850cf2-06ec-41cd-a31f-73187ad41f5c', '62f2c268-0e28-4bcb-9098-73e9514d950b', '1f04a613-9c4b-4a71-bf5a-5ce426d4e625', 'c025ed16-3a71-49ea-a35b-8d21e9445dc0'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:25 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f2a94bb0-e15e-4854-b714-fee746819d92 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-d2174d94-f422-4706-a9e6-2d4671693896-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:25 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 1G" returned: 0 in 0.422s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:25 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 Jul 24 16:00:25 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:26 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57" returned: 0 in 0.290s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:26 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 is being set with open permissions: ugo+rw Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:26 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 Jul 24 16:00:26 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-7c90f846-fcd7-46e7-bb78-cfc83f4e212e-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-7c90f846-fcd7-46e7-bb78-cfc83f4e212e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:26 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57" returned: 0 in 0.256s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb78261-f8e4-4f82-926d-e31217bbc67a]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:26 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.info Jul 24 16:00:26 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:26 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e Jul 24 16:00:26 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:26 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.info" returned: 0 in 0.269s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:26 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.info is being set with open permissions: ugo+rw Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:26 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.info Jul 24 16:00:26 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:26 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" returned: 0 in 0.369s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:26 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e Jul 24 16:00:26 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:26 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.info" returned: 0 in 0.240s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:26 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-943f46ab-0f11-4082-840c-a291fe1044cb tempest-ProjectReaderTests-1356326473 None] Create snapshot completed successfully Jul 24 16:00:26 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" returned: 0 in 0.263s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:26 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-7c90f846-fcd7-46e7-bb78-cfc83f4e212e" released by "delete_volume" :: held 0.691s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Created reservations ['73a95e97-45cc-42a9-beeb-0d62a8a54fc7', 'cb22a9c8-974a-4e82-962e-e843f2244332', '75946d8b-b05c-424a-8116-bbbe7fb89ff3', '2adca0c4-5720-4734-89aa-db48d6851f25'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Lock "cinder-620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-b315d8ce-a2f6-4cfe-867e-879b0e92be71" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-b315d8ce-a2f6-4cfe-867e-879b0e92be71" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Deleting offline snapshot 620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 of volume b315d8ce-a2f6-4cfe-867e-879b0e92be71 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] snapshot_file for this snap is: volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c684cd0d-a5ae-4b49-9abc-a048164fa587]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:27 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:27 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:27 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 Jul 24 16:00:27 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:27 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.279s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:27 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-5d4b88ce-85ce-4777-b896-fe629f5b16e6 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-7c90f846-fcd7-46e7-bb78-cfc83f4e212e-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:27 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57" returned: 0 in 0.412s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[90249393-0120-4f71-8416-01fa361ceee3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:27 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 Jul 24 16:00:27 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ff0e97df-6426-4df0-9e79-f4d8793e3d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc03ee9-0a5a-41aa-93e1-96fc3dc11ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc03ee9-0a5a-41aa-93e1-96fc3dc11ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-129192440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa814e8d-835d-4aca-9556-509be7065317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:28Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325a1837-ea40-4d01-b429-26bd09c21681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325a1837-ea40-4d01-b429-26bd09c21681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de20f49-27d4-419e-ba5a-3a936ecdf5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de20f49-27d4-419e-ba5a-3a936ecdf5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa814e8d-835d-4aca-9556-509be7065317', 'volume_name': 'volume-fa814e8d-835d-4aca-9556-509be7065317', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e9c125-a1a2-4116-ae42-88b38399277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e9c125-a1a2-4116-ae42-88b38399277d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c22d04-a22e-4ad8-9bac-28d04a28f846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Volume fa814e8d-835d-4aca-9556-509be7065317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa814e8d-835d-4aca-9556-509be7065317', 'volume_size': 1} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-129192440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa814e8d-835d-4aca-9556-509be7065317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:28Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Creating volume fa814e8d-835d-4aca-9556-509be7065317 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:27 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:27 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71" returned: 0 in 0.353s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:27 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:27 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 1073741824 Jul 24 16:00:27 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:27 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 Jul 24 16:00:27 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:28 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57" returned: 0 in 0.362s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:28 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57 Jul 24 16:00:28 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:28 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 1073741824" returned: 0 in 0.450s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:28 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 Jul 24 16:00:28 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:28 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71.620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57" returned: 0 in 0.251s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57" released by "_delete_snapshot" :: held 1.486s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-b315d8ce-a2f6-4cfe-867e-879b0e92be71" released by "delete_snapshot" :: held 1.514s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Created reservations ['fe029df5-e289-4ea9-881f-a2304f1e8af4', 'fe5d3b0b-6480-47dd-b659-d19a1271cc80', '9c4a0970-923a-4cd8-a96a-79ce5bf583d7', '81173ed2-8c79-4f2c-9ba1-2602188a66c1'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:28 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317" returned: 0 in 0.252s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c22d04-a22e-4ad8-9bac-28d04a28f846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa814e8d-835d-4aca-9556-509be7065317', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35034f0-f5a8-4ded-a45b-faedf3d8d20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:28 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Volume volume-fa814e8d-835d-4aca-9556-509be7065317 (fa814e8d-835d-4aca-9556-509be7065317): created successfully Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35034f0-f5a8-4ded-a45b-faedf3d8d20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ff0e97df-6426-4df0-9e79-f4d8793e3d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-ee717135-0dda-4511-9b24-cbc4209a1ca6 tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 16:00:28 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Delete snapshot completed successfully. Jul 24 16:00:28 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-98c79da8-368c-436d-bb58-2c31b54325ac tempest-ProjectReaderTests-1356326473 None] Lock "cinder-620eeaa5-4ddc-435d-a0a1-ac5d08d1ee57-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot 9586b3b0-c254-479d-9466-1eb561c54268 of volume fa814e8d-835d-4aca-9556-509be7065317 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5b695-7c3d-469d-aa83-e7abe353ea4d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-b315d8ce-a2f6-4cfe-867e-879b0e92be71-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:29 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 Jul 24 16:00:29 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-b315d8ce-a2f6-4cfe-867e-879b0e92be71-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-b315d8ce-a2f6-4cfe-867e-879b0e92be71" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-b315d8ce-a2f6-4cfe-867e-879b0e92be71" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5735f623-0c91-4f9c-975d-80a7e1b021ab]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:29 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 Jul 24 16:00:29 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:29 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317" returned: 0 in 0.396s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:29 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 1G Jul 24 16:00:29 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:29 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71" returned: 0 in 0.356s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:29 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71 Jul 24 16:00:29 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:29 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 1G" returned: 0 in 0.390s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa814e8d-835d-4aca-9556-509be7065317 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:29 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa814e8d-835d-4aca-9556-509be7065317 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 Jul 24 16:00:29 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:29 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-b315d8ce-a2f6-4cfe-867e-879b0e92be71" returned: 0 in 0.247s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-b315d8ce-a2f6-4cfe-867e-879b0e92be71" released by "delete_volume" :: held 0.659s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:29 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Created reservations ['95ce0b67-1a8f-47bb-97e0-60599c17bf6e', '27d92bbd-0e96-4c8d-801f-cbcae7c066ba', '625068e5-4a33-4790-a7ae-7f924b9f8611', '4be05163-1acb-4b04-817d-423730952a02'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:30 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:30 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:30 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa814e8d-835d-4aca-9556-509be7065317 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268" returned: 0 in 0.303s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:30 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 is being set with open permissions: ugo+rw Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:30 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 Jul 24 16:00:30 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:30 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.261s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:30 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Deleted volume successfully. Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-cb255278-c778-41a7-879c-149e57bf4910 tempest-ProjectReaderTests-1356326473 None] Lock "cinder-b315d8ce-a2f6-4cfe-867e-879b0e92be71-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:30 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268" returned: 0 in 0.250s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:30 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.info Jul 24 16:00:30 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:30 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.info" returned: 0 in 0.268s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:30 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.info is being set with open permissions: ugo+rw Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:30 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.info Jul 24 16:00:30 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (76c7bf3c-f70a-4097-9ad1-f635bf808702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0377fa37-24b0-4a61-a6eb-12671e6b44a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0377fa37-24b0-4a61-a6eb-12671e6b44a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723466443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51238d12-50fb-48cd-b142-eab791585fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:31Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a346c2a8-ad7c-4d22-952d-7a7a4121b5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a346c2a8-ad7c-4d22-952d-7a7a4121b5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd480e5-8432-41e6-a60f-48688eb51625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd480e5-8432-41e6-a60f-48688eb51625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51238d12-50fb-48cd-b142-eab791585fb5', 'volume_name': 'volume-51238d12-50fb-48cd-b142-eab791585fb5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb88cabb-7e38-4616-abb1-4e62d24b92bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb88cabb-7e38-4616-abb1-4e62d24b92bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d799be19-5d4c-4c43-886c-129a9614469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:30 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Volume 51238d12-50fb-48cd-b142-eab791585fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51238d12-50fb-48cd-b142-eab791585fb5', 'volume_size': 1} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:30 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.info" returned: 0 in 0.249s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723466443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51238d12-50fb-48cd-b142-eab791585fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9819f7b2482542a1ba017ae336d5f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:31Z,use_quota=True,user_id='715a966892b746369a17324e287d1fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Creating volume 51238d12-50fb-48cd-b142-eab791585fb5 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:30 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:31 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 1073741824 Jul 24 16:00:31 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-dddb2e09-2b12-4305-81aa-7f294d3030b9 tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-9586b3b0-c254-479d-9466-1eb561c54268-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Lock "cinder-9586b3b0-c254-479d-9466-1eb561c54268-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-fa814e8d-835d-4aca-9556-509be7065317" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-fa814e8d-835d-4aca-9556-509be7065317" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-9586b3b0-c254-479d-9466-1eb561c54268" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-9586b3b0-c254-479d-9466-1eb561c54268" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot 9586b3b0-c254-479d-9466-1eb561c54268 of volume fa814e8d-835d-4aca-9556-509be7065317 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab227e-454d-4352-bf38-ee553846ad3c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:31 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 Jul 24 16:00:31 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:31 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 1073741824" returned: 0 in 0.461s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:31 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 Jul 24 16:00:31 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:31 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa814e8d-835d-4aca-9556-509be7065317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f007cf11-ada8-4b18-a55a-38cb188cb9e3]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:31 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5" returned: 0 in 0.247s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d799be19-5d4c-4c43-886c-129a9614469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51238d12-50fb-48cd-b142-eab791585fb5', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb20ee50-9180-4b73-8730-9e688d1823b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:31 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Volume volume-51238d12-50fb-48cd-b142-eab791585fb5 (51238d12-50fb-48cd-b142-eab791585fb5): created successfully Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb20ee50-9180-4b73-8730-9e688d1823b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Flow 'volume_create_manager' (76c7bf3c-f70a-4097-9ad1-f635bf808702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:31 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 Jul 24 16:00:31 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-2da5f85e-02bb-4615-818e-c5d46aee03cf tempest-ProjectReaderTests-1356326473 None] Created volume successfully. Jul 24 16:00:32 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317" returned: 0 in 0.370s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:32 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 Jul 24 16:00:32 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:32 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268" returned: 0 in 0.317s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:32 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268 Jul 24 16:00:32 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:32 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317.9586b3b0-c254-479d-9466-1eb561c54268" returned: 0 in 0.229s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-9586b3b0-c254-479d-9466-1eb561c54268" released by "_delete_snapshot" :: held 1.344s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-fa814e8d-835d-4aca-9556-509be7065317" released by "delete_snapshot" :: held 1.366s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Created reservations ['018f742c-eb77-445a-b548-ca3636aa5566', 'e2584568-fa3f-4e36-8a39-9d39a463c204', '1e1ee7e7-0572-4a17-a451-97d32b23d5c4', 'fde08eec-08b4-41e0-8486-216fc47de3d1'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:32 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 16:00:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-714f187e-1398-4e79-a522-f5a1fd987eeb tempest-ProjectMemberTests-1287344200 None] Lock "cinder-9586b3b0-c254-479d-9466-1eb561c54268-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Creating offline snapshot c491ead0-6d84-424e-b730-0c2a77548c53 of volume 51238d12-50fb-48cd-b142-eab791585fb5 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafaa84f-460e-4d51-9191-126323f898e2]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:33 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 Jul 24 16:00:33 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-fa814e8d-835d-4aca-9556-509be7065317-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-fa814e8d-835d-4aca-9556-509be7065317-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:33 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5" returned: 0 in 0.363s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:33 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 1G Jul 24 16:00:33 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-fa814e8d-835d-4aca-9556-509be7065317" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-fa814e8d-835d-4aca-9556-509be7065317" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aee7895-444e-4cb3-b15f-99bf942a4f56]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:33 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 Jul 24 16:00:33 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:33 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 1G" returned: 0 in 0.403s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51238d12-50fb-48cd-b142-eab791585fb5 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:33 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51238d12-50fb-48cd-b142-eab791585fb5 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 Jul 24 16:00:33 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:33 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317" returned: 0 in 0.374s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:33 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317 Jul 24 16:00:33 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:34 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-fa814e8d-835d-4aca-9556-509be7065317" returned: 0 in 0.252s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:34 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51238d12-50fb-48cd-b142-eab791585fb5 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53" returned: 0 in 0.324s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:34 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 is being set with open permissions: ugo+rw Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-fa814e8d-835d-4aca-9556-509be7065317" released by "delete_volume" :: held 0.695s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:34 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 Jul 24 16:00:34 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Created reservations ['4e4b03cc-0f14-47f3-ac4f-101a01ba406c', 'b71a5b4d-adf9-41bc-8505-ae4e2ab8aa95', '394feb12-0629-4df5-a356-225b800e7e84', 'c4524431-7bdb-4267-8d18-5eb5c1980e70'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:34 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:34 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:34 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53" returned: 0 in 0.309s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:34 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.info Jul 24 16:00:34 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:34 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.279s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:34 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-a74436f9-d175-4d20-bd61-52bafcd750b1 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-fa814e8d-835d-4aca-9556-509be7065317-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:34 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:34 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:34 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.info" returned: 0 in 0.323s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:34 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.info is being set with open permissions: ugo+rw Jul 24 16:00:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:34 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.info Jul 24 16:00:34 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (6d66f402-a3d7-4dab-ac53-361903715c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae580cc8-c3da-4e39-bc8c-e4e619ea2e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae580cc8-c3da-4e39-bc8c-e4e619ea2e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1481537958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ed1c74-177f-406f-833b-d0e458325313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:35Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ecbdbdb-0c13-4b0e-a1c5-2b7b011124fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ecbdbdb-0c13-4b0e-a1c5-2b7b011124fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5e88bd-68f9-4237-86b6-8adfed803c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:35 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5e88bd-68f9-4237-86b6-8adfed803c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ed1c74-177f-406f-833b-d0e458325313', 'volume_name': 'volume-69ed1c74-177f-406f-833b-d0e458325313', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168d5891-0eb8-4a21-8c33-3826f0202f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168d5891-0eb8-4a21-8c33-3826f0202f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd0ecef-c3b7-4f66-a147-792ead9cd58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:35 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Volume 69ed1c74-177f-406f-833b-d0e458325313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ed1c74-177f-406f-833b-d0e458325313', 'volume_size': 1} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.323s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 16:00:35 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.info" returned: 0 in 0.310s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1481537958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ed1c74-177f-406f-833b-d0e458325313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:35Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Creating volume 69ed1c74-177f-406f-833b-d0e458325313 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:35 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:35 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 1073741824 Jul 24 16:00:35 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-812e380c-f8d5-4bab-9675-e14e746cfbfa tempest-ProjectReaderTests-1356326473 None] Create snapshot completed successfully Jul 24 16:00:35 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 1073741824" returned: 0 in 0.417s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:35 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 Jul 24 16:00:35 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:35 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313" returned: 0 in 0.245s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd0ecef-c3b7-4f66-a147-792ead9cd58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ed1c74-177f-406f-833b-d0e458325313', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf784e9-88b9-4087-8610-a415f71e5c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:35 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Volume volume-69ed1c74-177f-406f-833b-d0e458325313 (69ed1c74-177f-406f-833b-d0e458325313): created successfully Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf784e9-88b9-4087-8610-a415f71e5c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (6d66f402-a3d7-4dab-ac53-361903715c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-e31ec725-6b6d-4fa1-8db8-5a57490563a6 tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-c491ead0-6d84-424e-b730-0c2a77548c53-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Lock "cinder-c491ead0-6d84-424e-b730-0c2a77548c53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-51238d12-50fb-48cd-b142-eab791585fb5" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-51238d12-50fb-48cd-b142-eab791585fb5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-c491ead0-6d84-424e-b730-0c2a77548c53" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-c491ead0-6d84-424e-b730-0c2a77548c53" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Deleting offline snapshot c491ead0-6d84-424e-b730-0c2a77548c53 of volume 51238d12-50fb-48cd-b142-eab791585fb5 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] snapshot_file for this snap is: volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5117b2-ce85-4372-ac66-ae885eaf5aa5]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:36 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 Jul 24 16:00:36 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:36 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53" returned: 0 in 0.348s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51238d12-50fb-48cd-b142-eab791585fb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30feeb2-be63-46cf-8b9d-ce214d7d674c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:36 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 Jul 24 16:00:36 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:37 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5" returned: 0 in 0.361s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:37 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 Jul 24 16:00:37 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot 76bf4532-236d-4eb7-8cf3-7ea76140501f of volume 69ed1c74-177f-406f-833b-d0e458325313 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b89a1e-57e7-4988-89c8-b33ff81f846b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:37 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 Jul 24 16:00:37 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:37 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53" returned: 0 in 0.374s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:37 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53 Jul 24 16:00:37 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:37 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313" returned: 0 in 0.361s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:37 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5.c491ead0-6d84-424e-b730-0c2a77548c53" returned: 0 in 0.252s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:37 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f 1G Jul 24 16:00:37 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-c491ead0-6d84-424e-b730-0c2a77548c53" released by "_delete_snapshot" :: held 1.428s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-51238d12-50fb-48cd-b142-eab791585fb5" released by "delete_snapshot" :: held 1.449s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Created reservations ['5ffad35d-d0e5-469f-90cd-b3ce4981fa67', '5a35c8f7-6841-43fb-9abb-d9bf0784f2ff', '13df4072-2b44-4f35-a79e-6fc147e3180f', '27905dec-52fe-44dc-bc1f-f8bc2f8df542'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:37 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Delete snapshot completed successfully. Jul 24 16:00:37 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-767def4d-ad7a-441c-82a2-9337485178ef tempest-ProjectReaderTests-1356326473 None] Lock "cinder-c491ead0-6d84-424e-b730-0c2a77548c53-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:38 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f 1G" returned: 0 in 0.413s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ed1c74-177f-406f-833b-d0e458325313 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:38 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ed1c74-177f-406f-833b-d0e458325313 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f Jul 24 16:00:38 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:38 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ed1c74-177f-406f-833b-d0e458325313 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f" returned: 0 in 0.310s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:38 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f is being set with open permissions: ugo+rw Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-51238d12-50fb-48cd-b142-eab791585fb5-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:38 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f Jul 24 16:00:38 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Lock "cinder-51238d12-50fb-48cd-b142-eab791585fb5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Acquiring lock "cinder-quobyte-51238d12-50fb-48cd-b142-eab791585fb5" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-51238d12-50fb-48cd-b142-eab791585fb5" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[347511f9-1c63-42bf-8805-00d218a42045]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:38 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 Jul 24 16:00:38 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:38 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f" returned: 0 in 0.265s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:38 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.info Jul 24 16:00:38 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:38 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5" returned: 0 in 0.360s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:38 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5 Jul 24 16:00:38 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:38 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.info" returned: 0 in 0.263s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:38 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.info is being set with open permissions: ugo+rw Jul 24 16:00:38 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:38 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.info Jul 24 16:00:38 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:39 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-51238d12-50fb-48cd-b142-eab791585fb5" returned: 0 in 0.257s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Lock "cinder-quobyte-51238d12-50fb-48cd-b142-eab791585fb5" released by "delete_volume" :: held 0.681s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:39 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.info" returned: 0 in 0.265s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Created reservations ['8db103b0-6a87-4da5-8e75-debfe1b457ff', 'a1681cea-7bb8-4e91-a45f-b01ec5e500da', '08a18321-8712-4049-b471-b2d3ae0c585f', '82bb5ebe-7110-40ee-bdc5-df7e3420163a'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:39 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-3fa7a7db-9c06-45f3-a1f8-870d9bd3d297 tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:39 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:39 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-76bf4532-236d-4eb7-8cf3-7ea76140501f-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Lock "cinder-76bf4532-236d-4eb7-8cf3-7ea76140501f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-69ed1c74-177f-406f-833b-d0e458325313" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-69ed1c74-177f-406f-833b-d0e458325313" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-76bf4532-236d-4eb7-8cf3-7ea76140501f" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-76bf4532-236d-4eb7-8cf3-7ea76140501f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot 76bf4532-236d-4eb7-8cf3-7ea76140501f of volume 69ed1c74-177f-406f-833b-d0e458325313 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd5552a-f77b-450c-bf58-45661d130633]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:39 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.267s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:39 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f Jul 24 16:00:39 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:39 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Deleted volume successfully. Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-f862ad6e-20de-4f67-a801-c7a7fb7f110b tempest-ProjectReaderTests-1356326473 None] Lock "cinder-51238d12-50fb-48cd-b142-eab791585fb5-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:39 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f" returned: 0 in 0.403s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69ed1c74-177f-406f-833b-d0e458325313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a662bc82-aadd-4656-8806-a0520da98c59]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:39 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:40 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 Jul 24 16:00:40 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:40 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313" returned: 0 in 0.378s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:40 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f Jul 24 16:00:40 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:40 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f" returned: 0 in 0.373s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:40 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f Jul 24 16:00:40 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:40 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:40 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313.76bf4532-236d-4eb7-8cf3-7ea76140501f" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-76bf4532-236d-4eb7-8cf3-7ea76140501f" released by "_delete_snapshot" :: held 1.520s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:40 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-69ed1c74-177f-406f-833b-d0e458325313" released by "delete_snapshot" :: held 1.545s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:41 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Created reservations ['a3eb0107-4683-4fe8-8fb8-4a019961cc5e', 'd8a3934c-1c66-492e-ae90-888cba237a99', 'e6a8daff-086c-4f67-8e2e-85d159dff8ae', 'e78f1b98-b8fe-4383-802e-6d1d9fae3a19'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:41 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 16:00:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-90ef753c-842a-44cf-b497-56855abbc8af tempest-ProjectMemberTests-1287344200 None] Lock "cinder-76bf4532-236d-4eb7-8cf3-7ea76140501f-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-69ed1c74-177f-406f-833b-d0e458325313-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-69ed1c74-177f-406f-833b-d0e458325313-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-69ed1c74-177f-406f-833b-d0e458325313" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:41 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-69ed1c74-177f-406f-833b-d0e458325313" acquired by "delete_volume" :: waited 0.019s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:41 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee17687-e1ab-49d6-8633-daf8700b5343]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:41 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:41 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 Jul 24 16:00:41 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:42 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313" returned: 0 in 0.384s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:42 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313 Jul 24 16:00:42 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:42 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-69ed1c74-177f-406f-833b-d0e458325313" returned: 0 in 0.258s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-69ed1c74-177f-406f-833b-d0e458325313" released by "delete_volume" :: held 0.705s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Created reservations ['85edceb8-3a05-4188-9451-5d503a21aadf', '86fc6059-8115-4688-996a-4ec5c1223e00', '8e671ba4-1161-4380-aa24-b8ac959d3bf6', '36c182d6-1ab0-41f6-a253-bc846391d6c6'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:42 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:42 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:42 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.267s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:42 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 16:00:42 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-aaf9ea6f-5928-4238-939f-4015b3c73bb6 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-69ed1c74-177f-406f-833b-d0e458325313-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ad7c703b-3600-4877-93d0-b48d904b10eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdcc005-3f16-4f4c-a2c2-5f8255e0dc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdcc005-3f16-4f4c-a2c2-5f8255e0dc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567820980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1eaa88-6aa3-4f98-914d-5b9882dbd31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:43Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe4ecfa-3ebc-4658-801c-45c18b6bbb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe4ecfa-3ebc-4658-801c-45c18b6bbb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0646bcca-35c0-458a-bb09-473d7598d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0646bcca-35c0-458a-bb09-473d7598d088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da1eaa88-6aa3-4f98-914d-5b9882dbd31a', 'volume_name': 'volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb36ee5d-ac72-4f79-af0b-f571f72766a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb36ee5d-ac72-4f79-af0b-f571f72766a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d188b680-d9a2-4427-96c2-28dc5890d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:43 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Volume da1eaa88-6aa3-4f98-914d-5b9882dbd31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a', 'volume_size': 1} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567820980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1eaa88-6aa3-4f98-914d-5b9882dbd31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:43Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Creating volume da1eaa88-6aa3-4f98-914d-5b9882dbd31a {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:43 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:43 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a 1073741824 Jul 24 16:00:43 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:43 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a 1073741824" returned: 0 in 0.397s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:43 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:43 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a Jul 24 16:00:43 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:44 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" returned: 0 in 0.251s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:44 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:44 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d188b680-d9a2-4427-96c2-28dc5890d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbcef75-f3a8-4cb9-9454-0b816103ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:44 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Volume volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a (da1eaa88-6aa3-4f98-914d-5b9882dbd31a): created successfully Jul 24 16:00:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbcef75-f3a8-4cb9-9454-0b816103ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:44 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ad7c703b-3600-4877-93d0-b48d904b10eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:44 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-25b24c07-54a7-44e2-95db-72a8bb7ed572 tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 16:00:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:45 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot 0eed83fd-4fc9-4905-a858-825b32b50054 of volume da1eaa88-6aa3-4f98-914d-5b9882dbd31a {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:45 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[041bde1a-e05e-4133-b413-1e133f7ecfd9]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:45 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a Jul 24 16:00:45 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:45 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" returned: 0 in 0.373s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:45 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:45 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 1G Jul 24 16:00:45 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:46 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 1G" returned: 0 in 0.430s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:46 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 Jul 24 16:00:46 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:46 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054" returned: 0 in 0.302s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:46 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 is being set with open permissions: ugo+rw Jul 24 16:00:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:46 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 Jul 24 16:00:46 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:46 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054" returned: 0 in 0.244s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:46 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:46 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.info Jul 24 16:00:46 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:47 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.info" returned: 0 in 0.264s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:47 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.info is being set with open permissions: ugo+rw Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:47 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.info Jul 24 16:00:47 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:47 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.info" returned: 0 in 0.238s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:47 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b4a8b2ef-90f9-4b81-a113-55009f052e82 tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-0eed83fd-4fc9-4905-a858-825b32b50054-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-0eed83fd-4fc9-4905-a858-825b32b50054-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-0eed83fd-4fc9-4905-a858-825b32b50054" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-0eed83fd-4fc9-4905-a858-825b32b50054" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot 0eed83fd-4fc9-4905-a858-825b32b50054 of volume da1eaa88-6aa3-4f98-914d-5b9882dbd31a {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87f2cbe-0f0c-479d-b30e-b154bded86a4]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:47 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:47 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 Jul 24 16:00:47 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:48 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054" returned: 0 in 0.379s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:48 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:48 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb3fc4-8797-42c7-83ea-8a1467fd8702]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:48 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a Jul 24 16:00:48 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:48 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" returned: 0 in 0.351s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:48 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 Jul 24 16:00:48 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:48 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054" returned: 0 in 0.377s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:48 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:48 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054 Jul 24 16:00:48 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:49 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a.0eed83fd-4fc9-4905-a858-825b32b50054" returned: 0 in 0.307s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-0eed83fd-4fc9-4905-a858-825b32b50054" released by "_delete_snapshot" :: held 1.517s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" released by "delete_snapshot" :: held 1.543s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Created reservations ['de66617e-2601-471c-9a61-2dfb6a0d7b95', '29c6f67e-e5cc-4969-a925-61a5838fc7c3', '1f4f369e-c3f2-411c-ac41-a04b07d06090', '07fa5cd2-d557-4ac4-b681-3c1975d49ecb'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:49 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-46ee5636-67f5-4b73-8b26-76a1964b5237 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-0eed83fd-4fc9-4905-a858-825b32b50054-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-da1eaa88-6aa3-4f98-914d-5b9882dbd31a-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-da1eaa88-6aa3-4f98-914d-5b9882dbd31a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3000c0-0d94-4f78-896a-b71f64c4895e]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:49 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:50 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a Jul 24 16:00:50 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:50 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" returned: 0 in 0.392s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:50 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a Jul 24 16:00:50 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:50 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" returned: 0 in 0.245s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-da1eaa88-6aa3-4f98-914d-5b9882dbd31a" released by "delete_volume" :: held 0.698s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Created reservations ['6076a2a8-7dfc-4866-b5cc-fde08d6ee582', 'ea6a5188-4cd8-4b08-b638-314802633bb2', '5dea770f-df62-424f-9bb4-0487e24cbd0e', 'eb9f7f94-dc90-4106-8fe6-cf94fe32d670'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:50 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:00:50 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:50 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.266s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:50 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 16:00:50 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-869c17a0-bd84-4af8-8176-6796140a5401 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-da1eaa88-6aa3-4f98-914d-5b9882dbd31a-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:DELETE=22,cinder:UPDATE=246,cinder:SELECT=203,cinder:INSERT=69 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ed239766-e0a0-470c-86cf-ec76a75fbe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75432fd0-8f60-4d33-a1f2-e3fbb38faece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75432fd0-8f60-4d33-a1f2-e3fbb38faece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096558763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d926fad-5c63-46b1-9e36-0b7fa7f3c68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:51Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a91e07-bff3-4e27-ad8b-257a3548d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a91e07-bff3-4e27-ad8b-257a3548d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18afab3-c8b5-4114-bd4c-0425d3890d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18afab3-c8b5-4114-bd4c-0425d3890d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d926fad-5c63-46b1-9e36-0b7fa7f3c68e', 'volume_name': 'volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bccec6-811e-4ec3-a784-2ff2ef81048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bccec6-811e-4ec3-a784-2ff2ef81048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a26482-3c38-4299-9407-674e1ebc7882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Volume 2d926fad-5c63-46b1-9e36-0b7fa7f3c68e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e', 'volume_size': 1} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096558763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d926fad-5c63-46b1-9e36-0b7fa7f3c68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc6f03ad9ce4729a66c59d5ae729d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:51Z,use_quota=True,user_id='737c46736c364d2abf901ac9c6402189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Creating volume 2d926fad-5c63-46b1-9e36-0b7fa7f3c68e {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:51 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:00:51 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:51 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e 1073741824 Jul 24 16:00:51 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:52 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e 1073741824" returned: 0 in 0.475s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:52 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e Jul 24 16:00:52 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:52 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" returned: 0 in 0.260s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a26482-3c38-4299-9407-674e1ebc7882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcefcf68-33a1-4d45-a499-f7197880d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:UPDATE=272,cinder:SELECT=189,cinder:INSERT=71,cinder:DELETE=22 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:00:52 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Volume volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e (2d926fad-5c63-46b1-9e36-0b7fa7f3c68e): created successfully Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcefcf68-33a1-4d45-a499-f7197880d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:52 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Flow 'volume_create_manager' (ed239766-e0a0-470c-86cf-ec76a75fbe3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:52 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-249d81cf-db44-467c-8922-b42ca5bbcb19 tempest-ProjectMemberTests-1287344200 None] Created volume successfully. Jul 24 16:00:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:53 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Creating offline snapshot 175da3ee-25d0-4e87-b2a5-8edd9b052a59 of volume 2d926fad-5c63-46b1-9e36-0b7fa7f3c68e {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:53 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[988cd84c-1cbc-49a0-abce-d8fd64543710]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:53 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:53 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e Jul 24 16:00:53 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:54 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" returned: 0 in 0.414s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:54 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 1G Jul 24 16:00:54 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:54 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 1G" returned: 0 in 0.437s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:54 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 Jul 24 16:00:54 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:54 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59" returned: 0 in 0.315s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:54 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 is being set with open permissions: ugo+rw Jul 24 16:00:54 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:54 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 Jul 24 16:00:54 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:55 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59" returned: 0 in 0.252s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:55 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.info Jul 24 16:00:55 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:55 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.info" returned: 0 in 0.260s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:55 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.info is being set with open permissions: ugo+rw Jul 24 16:00:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:55 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.info Jul 24 16:00:55 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:55 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.info" returned: 0 in 0.247s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:55 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:55 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-0cc40b4a-0fdf-4a7c-b575-05dd530fa0cd tempest-ProjectMemberTests-1287344200 None] Create snapshot completed successfully Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-175da3ee-25d0-4e87-b2a5-8edd9b052a59-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-175da3ee-25d0-4e87-b2a5-8edd9b052a59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-175da3ee-25d0-4e87-b2a5-8edd9b052a59" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-175da3ee-25d0-4e87-b2a5-8edd9b052a59" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Deleting offline snapshot 175da3ee-25d0-4e87-b2a5-8edd9b052a59 of volume 2d926fad-5c63-46b1-9e36-0b7fa7f3c68e {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] snapshot_file for this snap is: volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d2bd36-5add-49c2-9d28-cd3f8ccf1324]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:57 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 Jul 24 16:00:57 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:57 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59" returned: 0 in 0.389s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc0448-bffd-4b59-bec3-f50774d3a475]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:57 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e Jul 24 16:00:57 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:57 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" returned: 0 in 0.378s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:57 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:57 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 Jul 24 16:00:57 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:58 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59" returned: 0 in 0.373s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:58 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59 Jul 24 16:00:58 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:58 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:58 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e.175da3ee-25d0-4e87-b2a5-8edd9b052a59" returned: 0 in 0.254s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-175da3ee-25d0-4e87-b2a5-8edd9b052a59" released by "_delete_snapshot" :: held 1.518s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" released by "delete_snapshot" :: held 1.544s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:58 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Created reservations ['8248bddc-4af2-4325-aa12-a052e2f79bf1', 'f4f2f300-adb3-43e2-8782-d2897657b0f0', 'b69ab2a3-41d5-43e7-a843-11cb0124665d', '6bb35530-d9ad-4a31-ab43-54ac8a5a9bd3'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:58 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Delete snapshot completed successfully. Jul 24 16:00:58 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d2d8bd06-478e-49be-9d45-2b6f2caa5d49 tempest-ProjectMemberTests-1287344200 None] Lock "cinder-175da3ee-25d0-4e87-b2a5-8edd9b052a59-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Lock "cinder-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Acquiring lock "cinder-quobyte-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" acquired by "delete_volume" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1515ee-c64d-42d6-878b-e8cd33d691c5]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:59 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e Jul 24 16:00:59 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:59 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" returned: 0 in 0.378s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:59 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e Jul 24 16:00:59 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:59 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" returned: 0 in 0.272s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:59 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Lock "cinder-quobyte-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e" released by "delete_volume" :: held 0.714s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Created reservations ['ab234800-4371-4568-91c4-a5d47dd37449', '02000574-52ab-4700-b220-dee8aabb3774', 'a17e6686-43bf-46f5-bbd8-3f4fab7a5703', '80058c20-93a5-4c5e-86d3-e146d4f61806'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:00 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:01:00 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:00 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.283s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:00 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Deleted volume successfully. Jul 24 16:01:00 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-91b542a3-8cb8-45c5-8f7c-176042faaacf tempest-ProjectMemberTests-1287344200 None] Lock "cinder-2d926fad-5c63-46b1-9e36-0b7fa7f3c68e-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Flow 'volume_create_manager' (961b7c24-55dc-4896-a902-82da06d78fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2dfcec2-ebf9-452d-93bc-879190d755bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2dfcec2-ebf9-452d-93bc-879190d755bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287864759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1450370d-56c6-46a8-b4c2-c6b0dd075ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fa9bdc485b4d8ea722e503ce1cbdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:04Z,use_quota=True,user_id='37a414b924ba43a8b475ff87a023bc20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7949a9d-ff95-4e3e-9a0e-73052a271688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7949a9d-ff95-4e3e-9a0e-73052a271688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e325ed1f-3e64-40e6-b6a9-2745aa59c29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e325ed1f-3e64-40e6-b6a9-2745aa59c29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1450370d-56c6-46a8-b4c2-c6b0dd075ceb', 'volume_name': 'volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0573a2f9-b157-4f8b-b141-43b351007c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0573a2f9-b157-4f8b-b141-43b351007c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fa5017-9a5d-496d-a699-7a4e9a86d899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:04 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Volume 1450370d-56c6-46a8-b4c2-c6b0dd075ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb', 'volume_size': 1} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287864759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1450370d-56c6-46a8-b4c2-c6b0dd075ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fa9bdc485b4d8ea722e503ce1cbdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:04Z,use_quota=True,user_id='37a414b924ba43a8b475ff87a023bc20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Creating volume 1450370d-56c6-46a8-b4c2-c6b0dd075ceb {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:04 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:01:04 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:04 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb 1073741824 Jul 24 16:01:04 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:05 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb 1073741824" returned: 0 in 0.501s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:05 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb Jul 24 16:01:05 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:05 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb" returned: 0 in 0.288s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fa5017-9a5d-496d-a699-7a4e9a86d899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fc1b19-82f1-4949-bb48-6280aab6bbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:05 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Volume volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb (1450370d-56c6-46a8-b4c2-c6b0dd075ceb): created successfully Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fc1b19-82f1-4949-bb48-6280aab6bbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:05 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Flow 'volume_create_manager' (961b7c24-55dc-4896-a902-82da06d78fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:05 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-35aff8ce-0d53-473f-abc2-0a77f6a831c2 tempest-ProjectReaderTests-1771456126 None] Created volume successfully. Jul 24 16:01:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Acquiring lock "cinder-1450370d-56c6-46a8-b4c2-c6b0dd075ceb-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Lock "cinder-1450370d-56c6-46a8-b4c2-c6b0dd075ceb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Acquiring lock "cinder-quobyte-1450370d-56c6-46a8-b4c2-c6b0dd075ceb" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:06 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Lock "cinder-quobyte-1450370d-56c6-46a8-b4c2-c6b0dd075ceb" acquired by "delete_volume" :: waited 0.016s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:06 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d0677a-7419-46ae-8ac5-1c1776ab01ac]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:06 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:07 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb Jul 24 16:01:07 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:07 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb" returned: 0 in 0.384s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:07 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb Jul 24 16:01:07 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:07 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1450370d-56c6-46a8-b4c2-c6b0dd075ceb" returned: 0 in 0.272s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Lock "cinder-quobyte-1450370d-56c6-46a8-b4c2-c6b0dd075ceb" released by "delete_volume" :: held 0.706s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Created reservations ['17950ad5-5aa4-4c0d-ae1a-c3e0cb87f268', 'd5ac32d3-f2e9-43ef-99ce-0d27fb54a122', 'abc1a40b-f39b-498d-bb0e-637c685344d6', '720b6d7d-20c8-405e-8063-3cd21123a724'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:07 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:07 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:01:07 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:08 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.277s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:08 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Deleted volume successfully. Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-791a0a52-d86f-4909-9105-2d0b75dda2ee tempest-ProjectReaderTests-1771456126 None] Lock "cinder-1450370d-56c6-46a8-b4c2-c6b0dd075ceb-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Flow 'volume_create_manager' (baa2c605-7bd1-4211-9a44-48fa6c406e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d463e5c-add0-4d3c-9280-c767275ada91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d463e5c-add0-4d3c-9280-c767275ada91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997532311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c211c0d-646c-4af7-a323-efb1830c8214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fa9bdc485b4d8ea722e503ce1cbdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:08Z,use_quota=True,user_id='37a414b924ba43a8b475ff87a023bc20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dadc174-5731-4600-ad6d-4eb8a4de746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dadc174-5731-4600-ad6d-4eb8a4de746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f57f35-37d9-4f63-9b33-94c6790165f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f57f35-37d9-4f63-9b33-94c6790165f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c211c0d-646c-4af7-a323-efb1830c8214', 'volume_name': 'volume-1c211c0d-646c-4af7-a323-efb1830c8214', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476c6c02-29df-4231-bfeb-0a864029dc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476c6c02-29df-4231-bfeb-0a864029dc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531d339b-8f0d-408d-b45f-d0010e685628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:08 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Volume 1c211c0d-646c-4af7-a323-efb1830c8214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c211c0d-646c-4af7-a323-efb1830c8214', 'volume_size': 1} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997532311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c211c0d-646c-4af7-a323-efb1830c8214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fa9bdc485b4d8ea722e503ce1cbdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:08Z,use_quota=True,user_id='37a414b924ba43a8b475ff87a023bc20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Creating volume 1c211c0d-646c-4af7-a323-efb1830c8214 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:08 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:01:08 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:08 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 1073741824 Jul 24 16:01:08 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:09 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 1073741824" returned: 0 in 0.548s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:09 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 Jul 24 16:01:09 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:09 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214" returned: 0 in 0.293s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531d339b-8f0d-408d-b45f-d0010e685628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c211c0d-646c-4af7-a323-efb1830c8214', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99fc2b6-b7cf-4b25-b171-8758a02662c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:09 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Volume volume-1c211c0d-646c-4af7-a323-efb1830c8214 (1c211c0d-646c-4af7-a323-efb1830c8214): created successfully Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99fc2b6-b7cf-4b25-b171-8758a02662c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:09 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Flow 'volume_create_manager' (baa2c605-7bd1-4211-9a44-48fa6c406e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:09 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8c3d7c28-6475-4e1e-b066-e22b0e91eec9 tempest-ProjectReaderTests-1771456126 None] Created volume successfully. Jul 24 16:01:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Acquiring lock "cinder-1c211c0d-646c-4af7-a323-efb1830c8214-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Lock "cinder-1c211c0d-646c-4af7-a323-efb1830c8214-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Acquiring lock "cinder-quobyte-1c211c0d-646c-4af7-a323-efb1830c8214" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:10 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Lock "cinder-quobyte-1c211c0d-646c-4af7-a323-efb1830c8214" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:10 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df63d5-500a-400b-b004-cc208675114f]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:10 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:10 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 Jul 24 16:01:10 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:11 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214" returned: 0 in 0.424s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:11 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214 Jul 24 16:01:11 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:11 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-1c211c0d-646c-4af7-a323-efb1830c8214" returned: 0 in 0.274s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Lock "cinder-quobyte-1c211c0d-646c-4af7-a323-efb1830c8214" released by "delete_volume" :: held 0.741s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Created reservations ['f5b6e00e-3cfa-459f-8a1b-39826df000bb', '95a73a8d-239a-4d6a-8a95-23c31e6974ca', '118a7a6c-a30e-4c3c-8802-6337e6abd345', 'ef9b3460-1ff6-433a-8937-a4804c33f987'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:11 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:01:11 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:11 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.324s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:11 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:11 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Deleted volume successfully. Jul 24 16:01:12 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-d13d76ac-a822-47ed-910d-d7431d1a94f6 tempest-ProjectReaderTests-1771456126 None] Lock "cinder-1c211c0d-646c-4af7-a323-efb1830c8214-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Flow 'volume_create_manager' (5e7a0c84-4555-4d2c-9311-eb3c3c1cb025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b50aa8-e985-48b7-a10f-3cca1591a7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b50aa8-e985-48b7-a10f-3cca1591a7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2004263906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203bfbbc906d43f38fbc82e3d5f7ac95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:22Z,use_quota=True,user_id='3c30c17034394250a2827e5cafbfbea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06df220c-013f-4233-8780-dcb095cd8a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06df220c-013f-4233-8780-dcb095cd8a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29a402e-e6e6-4475-b6a9-62ceb902cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29a402e-e6e6-4475-b6a9-62ceb902cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64', 'volume_name': 'volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722161eb-be25-4cba-b8f1-574b9177e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722161eb-be25-4cba-b8f1-574b9177e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b223f96-8e15-45e7-a5db-b7f3ce093e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Volume 75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64', 'volume_size': 1} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2004263906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203bfbbc906d43f38fbc82e3d5f7ac95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:22Z,use_quota=True,user_id='3c30c17034394250a2827e5cafbfbea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)}" {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Creating volume 75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:21 devstack cinder-volume[88251]: INFO cinder.volume.drivers.remotefs [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] casted to osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 Jul 24 16:01:21 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 1073741824 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:21 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 1073741824 Jul 24 16:01:21 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:22 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 1073741824" returned: 0 in 0.432s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:22 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 Jul 24 16:01:22 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:22 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" returned: 0 in 0.256s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'} {{(pid=88251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b223f96-8e15-45e7-a5db-b7f3ce093e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64', 'volume_size': 1}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07edd6ad-65c3-4b51-8c3d-193cdc3a400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Volume volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 (75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64): created successfully Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07edd6ad-65c3-4b51-8c3d-193cdc3a400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Flow 'volume_create_manager' (5e7a0c84-4555-4d2c-9311-eb3c3c1cb025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:22 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-8c8abae4-8ef2-44f9-8f41-8e58ffa87fc2 tempest-SnapshotDependencyTests-903413368 None] Created volume successfully. Jul 24 16:01:22 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:23 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Creating offline snapshot d74539f8-d2f0-4713-80a4-e7bc83c67971 of volume 75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:01:23 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4f6487-5982-4dfb-907d-6a6c5117466d]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:23 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 Jul 24 16:01:23 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:23 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" returned: 0 in 0.352s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 1G {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:23 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 1G Jul 24 16:01:23 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:23 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 1G" returned: 0 in 0.385s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:23 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:23 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 Jul 24 16:01:23 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:24 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 -F qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971" returned: 0 in 0.285s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:24 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 is being set with open permissions: ugo+rw Jul 24 16:01:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:24 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 Jul 24 16:01:24 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:24 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971" returned: 0 in 0.228s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:24 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.info Jul 24 16:01:24 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:24 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.info" returned: 0 in 0.233s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:24 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.info is being set with open permissions: ugo+rw Jul 24 16:01:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.info {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:24 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.info Jul 24 16:01:24 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:24 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.info" returned: 0 in 0.230s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:24 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:24 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b6a5d5f7-47e2-4038-97b4-65f4f1cdebcc tempest-SnapshotDependencyTests-903413368 None] Create snapshot completed successfully Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Flow 'volume_create_manager' (fb411d6c-9835-421c-8521-4b164fb05893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b3eea1-135d-4dad-b108-41da13a49c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b3eea1-135d-4dad-b108-41da13a49c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269c7cef-2fd5-4aaa-aa51-3f252a60e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203bfbbc906d43f38fbc82e3d5f7ac95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d74539f8-d2f0-4713-80a4-e7bc83c67971,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:26Z,use_quota=True,user_id='3c30c17034394250a2827e5cafbfbea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c447f-bb2b-4949-bc5c-750da10b2866),volume_type_id=432c447f-bb2b-4949-bc5c-750da10b2866)' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0802ef81-3f79-4c38-bdd2-8ee3135bb29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0802ef81-3f79-4c38-bdd2-8ee3135bb29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5538c9-3268-4a65-b79d-a13c26346e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5538c9-3268-4a65-b79d-a13c26346e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '269c7cef-2fd5-4aaa-aa51-3f252a60e3fa', 'volume_name': 'volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa', 'volume_size': 1, 'snapshot_id': 'd74539f8-d2f0-4713-80a4-e7bc83c67971'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30316bc6-b803-4e34-be47-a176e05b49aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30316bc6-b803-4e34-be47-a176e05b49aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d3a3bb-0166-4ac0-9abe-9844aebfbb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:25 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Volume 269c7cef-2fd5-4aaa-aa51-3f252a60e3fa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa', 'volume_size': 1, 'snapshot_id': 'd74539f8-d2f0-4713-80a4-e7bc83c67971'} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-quobyte-d74539f8-d2f0-4713-80a4-e7bc83c67971-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" by "_create_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-d74539f8-d2f0-4713-80a4-e7bc83c67971-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Creating volume 269c7cef-2fd5-4aaa-aa51-3f252a60e3fa from snapshot d74539f8-d2f0-4713-80a4-e7bc83c67971 {{(pid=88251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Selected osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540 as target Quobyte volume. {{(pid=88251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-quobyte-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" by "_copy_volume_from_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] snapshot: d74539f8-d2f0-4713-80a4-e7bc83c67971, volume: 269c7cef-2fd5-4aaa-aa51-3f252a60e3fa, {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[897c0c09-e8d3-401c-ab93-e80560bb577c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:25 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:25 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 Jul 24 16:01:25 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:26 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971" returned: 0 in 0.346s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Creating direct copy from snapshot {{(pid=88251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e423fb00-0ee6-41c2-ae4c-8088bdfd6786]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:26 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 Jul 24 16:01:26 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:26 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" returned: 0 in 0.364s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG cinder.utils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Path /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa not found in is_blk_device check {{(pid=88251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 16:01:26 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:26 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa Jul 24 16:01:26 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:30 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" returned: 0 in 3.924s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:30 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[702abcfd-d4c6-4397-ae1a-67a22773d26c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:30 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:30 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 Jul 24 16:01:30 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:31 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" returned: 0 in 0.528s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG cinder.image.image_utils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa {{(pid=88251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 16:01:31 devstack cinder-volume[88251]: INFO cinder.image.image_utils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Converted 1024.00 MB image at 260.91 MB/s Jul 24 16:01:31 devstack cinder-volume[88251]: WARNING cinder.volume.drivers.remotefs [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa is being set with open permissions: ugo+rw Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:31 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa Jul 24 16:01:31 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:31 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" returned: 0 in 0.251s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" released by "_copy_volume_from_snapshot" :: held 5.502s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-d74539f8-d2f0-4713-80a4-e7bc83c67971-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" released by "_create_volume_from_snapshot" :: held 5.531s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.546s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d3a3bb-0166-4ac0-9abe-9844aebfbb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa', 'volume_size': 1, 'snapshot_id': 'd74539f8-d2f0-4713-80a4-e7bc83c67971'}' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5383f338-dbe1-4ef4-acac-1b34190e63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:31 devstack cinder-volume[88251]: INFO cinder.volume.flows.manager.create_volume [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Volume volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa (269c7cef-2fd5-4aaa-aa51-3f252a60e3fa): created successfully Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5383f338-dbe1-4ef4-acac-1b34190e63c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:31 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Flow 'volume_create_manager' (fb411d6c-9835-421c-8521-4b164fb05893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:31 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-b71a5ad9-19df-4d62-b49f-995bea5c591e tempest-SnapshotDependencyTests-903413368 None] Created volume successfully. Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-d74539f8-d2f0-4713-80a4-e7bc83c67971-delete_snapshot" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-d74539f8-d2f0-4713-80a4-e7bc83c67971-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-quobyte-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" by "delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-quobyte-d74539f8-d2f0-4713-80a4-e7bc83c67971" by "_delete_snapshot" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-d74539f8-d2f0-4713-80a4-e7bc83c67971" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Deleting offline snapshot d74539f8-d2f0-4713-80a4-e7bc83c67971 of volume 75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] snapshot_file for this snap is: volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 {{(pid=88251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2a7f61-5451-4b5a-be93-adb28dc89158]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:32 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 Jul 24 16:01:32 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:32 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971" returned: 0 in 0.342s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.remotefs [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e7613-e78c-4245-8bac-78c4be95d84c]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:32 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:32 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 Jul 24 16:01:32 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:33 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" returned: 0 in 0.344s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:33 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 Jul 24 16:01:33 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:33 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971" returned: 0 in 0.346s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:33 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971 Jul 24 16:01:33 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:33 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64.d74539f8-d2f0-4713-80a4-e7bc83c67971" returned: 0 in 0.255s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-d74539f8-d2f0-4713-80a4-e7bc83c67971" released by "_delete_snapshot" :: held 1.384s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" released by "delete_snapshot" :: held 1.410s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Created reservations ['36bddd33-2a21-45fe-bcaa-40c4672a4bf2', '46302e5d-2bf8-4fde-b5b6-84a4f3f1541d', 'f31a5a89-84fa-4469-8746-d6104539a790', 'c8dd440e-dd3b-44cb-be50-69939e7be263'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:33 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Delete snapshot completed successfully. Jul 24 16:01:33 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-143d652d-a546-454e-8b2d-f30894060ca6 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-d74539f8-d2f0-4713-80a4-e7bc83c67971-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-quobyte-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" acquired by "delete_volume" :: waited 0.014s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d08b5-c58f-40af-9f3a-38042ac5bebe]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:34 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 Jul 24 16:01:34 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:34 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:01:34 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:34 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" returned: 0 in 0.350s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:34 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:34 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64 Jul 24 16:01:34 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:35 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.244s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_service.periodic_task [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] Running periodic task VolumeManager._thread_info {{(pid=88251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread count: 29 {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.volume.manager [None req-4e7f7d42-31cb-48cd-9821-fafa0c3e92fe None None] thread info: [<_MainThread(MainThread, started 131630619172992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 16:01:35 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" returned: 0 in 0.263s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64" released by "delete_volume" :: held 0.670s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Created reservations ['d9b74ec2-5be5-42b5-a978-bcf6f1e365b2', '26e3f852-8d4e-4bed-9628-a2d253a3dcfb', '8fe15d9a-0746-4c39-8f36-9e216adba24a', '119070c7-1ccb-4bb7-90cd-715163289c10'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:35 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:01:35 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:35 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.261s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:35 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Deleted volume successfully. Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-da6c73f3-7e30-4a9d-bac0-6861cfe02794 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-75b030e2-fa4d-4cf0-be41-f7ea9d7b2b64-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa-delete_volume" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "cinder-quobyte-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" by "delete_volume" {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" acquired by "delete_volume" :: waited 0.013s {{(pid=88251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4658a860-b455-45e8-ae22-c5ad591e3d7b]: (4, 'qcow2') {{(pid=90409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:35 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:35 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa Jul 24 16:01:35 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:36 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" returned: 0 in 0.354s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:36 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa Jul 24 16:01:36 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:36 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f/volume-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" returned: 0 in 0.238s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-quobyte-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa" released by "delete_volume" :: held 0.630s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG cinder.quota [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Created reservations ['fb570a8f-5156-4e77-9516-fa2b5855a3f7', 'ea3cdd0d-1cf1-40dd-9003-cbfa6bbb480f', '35ad66d5-0d61-4d3d-91c7-9dd7430b2d62', '57bbb2f8-c6e8-494d-8602-29561e73a97f'] {{(pid=88251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540': None} {{(pid=88251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG cinder.volume.drivers.quobyte [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb80878d-58d7-4797-909e-7322b0c21540'] {{(pid=88251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.lockutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:36 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f Jul 24 16:01:36 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:36 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG oslo_concurrency.processutils [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ff86a6ec59ce163fc860aeee326598f" returned: 0 in 0.236s {{(pid=88251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG cinder.manager [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Notifying Schedulers of capabilities ... {{(pid=88251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:36 devstack cinder-volume[88251]: INFO cinder.volume.manager [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Deleted volume successfully. Jul 24 16:01:36 devstack cinder-volume[88251]: DEBUG cinder.coordination [None req-63b5658d-5a69-4ba0-8734-56fee4295c92 tempest-SnapshotDependencyTests-903413368 None] Lock "cinder-269c7cef-2fd5-4aaa-aa51-3f252a60e3fa-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=88251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:46 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=49,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=16 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:01:46 devstack cinder-volume[88251]: DEBUG dbcounter [-] [88251] Writing DB stats cinder:SELECT=52,cinder:UPDATE=71,cinder:INSERT=17,cinder:DELETE=5 {{(pid=88251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}